vm-test-run-nixbot-gitlab
default.checks.aarch64-linux.nixbot-gitlab
· build #234
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 46)10gitlab # Disk image does not exist, creating the virtualisation disk image...11gitlab # Formatting '/build/vm-state-gitlab/tmp.hQ4REKopxy', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13(finished: start all VMs, in 74.47 seconds)14gitlab # Discarding device blocks: 0/262144 done15gitlab: waiting for unit setup-gitlab.service16gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes17gitlab: waiting for the VM to finish booting18gitlab # Filesystem UUID: 1bb6c3c1-672c-42c6-b01f-2cbb21ba72b419gitlab # Superblock backups stored on blocks:20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]31gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Thu Aug 6 17:27:09 UTC 202632gitlab # [ 0.000000] KASLR enabled33gitlab # [ 0.000000] random: crng init done34gitlab # [ 0.000000] Machine model: linux,dummy-virt35gitlab # [ 0.000000] efi: UEFI not found.36gitlab # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT37gitlab # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff]38gitlab # [ 0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf]39gitlab # [ 0.000000] Zone ranges:40gitlab # [ 0.000000] DMA [mem 0x0000000040000000-0x00000000ffffffff]41gitlab # [ 0.000000] DMA32 empty42gitlab # [ 0.000000] Normal [mem 0x0000000100000000-0x00000001bfffffff]43gitlab # [ 0.000000] Device empty44gitlab # [ 0.000000] Movable zone start for each node45gitlab # [ 0.000000] Early memory node ranges46gitlab # [ 0.000000] node 0: [mem 0x0000000040000000-0x00000001bfffffff]47gitlab # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff]48gitlab # [ 0.000000] cma: Reserved 32 MiB at 0x00000000fe00000049gitlab # [ 0.000000] psci: probing for conduit method from DT.50gitlab # [ 0.000000] psci: PSCIv1.3 detected in firmware.51gitlab # [ 0.000000] psci: Using standard PSCI v0.2 function IDs52gitlab # [ 0.000000] psci: Trusted OS migration not required53gitlab # [ 0.000000] psci: SMC Calling Convention v1.154gitlab # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)55gitlab # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u31129656gitlab # [ 0.000000] Detected PIPT I-cache on CPU057gitlab # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)58gitlab # [ 0.000000] CPU features: detected: GICv3 CPU interface59gitlab # [ 0.000000] CPU features: detected: Spectre-v460gitlab # [ 0.000000] CPU features: detected: Spectre-BHB61gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_3862gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_2363gitlab # [ 0.000000] alternatives: applying boot alternatives64gitlab # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/4cz564bp70gwwkqhzfnzcvrknb17cnh9-nixos-system-gitlab-test/init regInfo=/nix/store/amv35fwx4faq38r3d9dwxzap1r8jmm91-closure-info/registration console=ttyAMA0,115200n8 console=tty065gitlab # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/amv35fwx4faq38r3d9dwxzap1r8jmm91-closure-info/registration", will be passed to user space.66gitlab # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes67gitlab # [ 0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)68gitlab # [ 0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)69gitlab # [ 0.000000] software IO TLB: area num 4.70gitlab # [ 0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB)71gitlab # [ 0.000000] Fallback order for Node 0: 072gitlab # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 157286473gitlab # [ 0.000000] Policy zone: Normal74gitlab # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off75gitlab # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=176gitlab # [ 0.000000] allocated 12582912 bytes of page_ext77gitlab # [ 0.000000] ftrace: allocating 74867 entries in 294 pages78gitlab # [ 0.000000] ftrace: allocated 294 pages with 4 groups79gitlab # [ 0.000000] rcu: Hierarchical RCU implementation.80gitlab # [ 0.000000] rcu: RCU event tracing is enabled.81gitlab # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.82gitlab # [ 0.000000] Trampoline variant of Tasks RCU enabled.83gitlab # [ 0.000000] Rude variant of Tasks RCU enabled.84gitlab # [ 0.000000] Tracing variant of Tasks RCU enabled.85gitlab # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.86gitlab # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=487gitlab # [ 0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.88gitlab # [ 0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.89gitlab # [ 0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.90gitlab # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 091gitlab # [ 0.000000] GICv3: 256 SPIs implemented92gitlab # [ 0.000000] GICv3: 0 Extended SPIs implemented93gitlab # [ 0.000000] Root IRQ handler: gic_handle_irq94gitlab # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI95gitlab # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=096gitlab # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a000097gitlab # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]98gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f10000 (indirect, esz 8, psz 64K, shr 1)99gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f20000 (flat, esz 8, psz 64K, shr 1)100gitlab # [ 0.000000] GICv3: using LPI property table @0x0000000100f30000101gitlab # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f40000102gitlab # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.103gitlab # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns104gitlab # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).105gitlab # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns106gitlab # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns107gitlab # [ 0.000033] arm-pv: using stolen time PV108gitlab # [ 0.000985] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)109gitlab # [ 0.001211] Console: colour dummy device 80x25110gitlab # [ 0.001219] printk: legacy console [tty0] enabled111gitlab # [ 0.001420] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)112gitlab # [ 0.001427] pid_max: default: 32768 minimum: 301113gitlab # [ 0.001513] LSM: initializing lsm=capability,landlock,yama,bpf,ima114gitlab # [ 0.001650] landlock: Up and running.115gitlab # [ 0.001653] Yama: becoming mindful.116gitlab # [ 0.002139] LSM support for eBPF active117gitlab # [ 0.002368] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)118gitlab # [ 0.002485] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)119gitlab # [ 0.003729] cacheinfo: Unable to detect cache hierarchy for CPU 0120gitlab # [ 0.004490] rcu: Hierarchical SRCU implementation.121gitlab # [ 0.004494] rcu: Max phase no-delay instances is 1000.122gitlab # [ 0.004663] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level123gitlab # [ 0.005754] fsl-mc MSI: its@8080000 domain created124gitlab # [ 0.005851] EFI services will not be available.125gitlab # [ 0.006042] smp: Bringing up secondary CPUs ...126gitlab # [ 0.006726] Detected PIPT I-cache on CPU1127gitlab # [ 0.006830] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000128gitlab # [ 0.006954] GICv3: CPU1: using allocated LPI pending table @0x0000000100f50000129gitlab # [ 0.007100] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40]130gitlab # [ 0.008201] Detected PIPT I-cache on CPU2131gitlab # [ 0.008313] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000132gitlab # [ 0.008439] GICv3: CPU2: using allocated LPI pending table @0x0000000100f60000133gitlab # [ 0.008568] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40]134gitlab # [ 0.009685] Detected PIPT I-cache on CPU3135gitlab # [ 0.009808] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000136gitlab # [ 0.009933] GICv3: CPU3: using allocated LPI pending table @0x0000000100f70000137gitlab # [ 0.010062] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40]138gitlab # [ 0.010633] smp: Brought up 1 node, 4 CPUs139gitlab # [ 0.010660] SMP: Total of 4 processors activated.140gitlab # [ 0.010663] CPU: All CPU(s) started at EL1141gitlab # [ 0.010672] CPU features: detected: Branch Target Identification142gitlab # [ 0.010677] CPU features: detected: ARMv8.4 Translation Table Level143gitlab # [ 0.010679] CPU features: detected: Instruction cache invalidation not required for I/D coherence144gitlab # [ 0.010683] CPU features: detected: Data cache clean to the PoU not required for I/D coherence145gitlab # [ 0.010686] CPU features: detected: Common not Private translations146gitlab # [ 0.010689] CPU features: detected: CRC32 instructions147gitlab # [ 0.010692] CPU features: detected: Data cache clean to Point of Deep Persistence148gitlab # [ 0.010695] CPU features: detected: Data cache clean to Point of Persistence149gitlab # [ 0.010698] CPU features: detected: Data independent timing control (DIT)150gitlab # [ 0.010700] CPU features: detected: E0PD151gitlab # [ 0.010703] CPU features: detected: Enhanced Counter Virtualization152gitlab # [ 0.010705] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)153gitlab # [ 0.010708] CPU features: detected: Enhanced Virtualization Traps154gitlab # [ 0.010711] CPU features: detected: Fine Grained Traps155gitlab # [ 0.010714] CPU features: detected: Generic authentication (architected QARMA5 algorithm)156gitlab # [ 0.010717] CPU features: detected: RCpc load-acquire (LDAPR)157gitlab # [ 0.010720] CPU features: detected: LSE atomic instructions158gitlab # [ 0.010722] CPU features: detected: Privileged Access Never159gitlab # [ 0.010725] CPU features: detected: PMUv3160gitlab # [ 0.010727] CPU features: detected: RAS Extension Support161gitlab # [ 0.010730] CPU features: detected: RASv1p1 Extension Support162gitlab # [ 0.010732] CPU features: detected: Random Number Generator163gitlab # [ 0.010734] CPU features: detected: Speculation barrier (SB)164gitlab # [ 0.010737] CPU features: detected: Stage-2 Force Write-Back165gitlab # [ 0.010739] CPU features: detected: TLB range maintenance instructions166gitlab # [ 0.010743] CPU features: detected: Speculative Store Bypassing Safe (SSBS)167gitlab # [ 0.010870] alternatives: applying system-wide alternatives168gitlab # [ 0.014088] CPU features: detected: BBM Level 2 without TLB conflict abort169gitlab # [ 0.014304] Memory: 5963764K/6291456K available (24448K kernel code, 7090K rwdata, 26340K rodata, 4736K init, 1106K bss, 272908K reserved, 32768K cma-reserved)170gitlab # [ 0.016118] devtmpfs: initialized171gitlab # [ 0.020477] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)172gitlab # [ 0.020552] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).173gitlab # [ 0.020785] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL174gitlab # [ 0.020790] 0 pages in range for non-PLT usage175gitlab # [ 0.020791] 508288 pages in range for PLT usage176gitlab # [ 0.020955] pinctrl core: initialized pinctrl subsystem177gitlab # [ 0.021856] DMI not present or invalid.178gitlab # [ 0.025524] NET: Registered PF_NETLINK/PF_ROUTE protocol family179gitlab # [ 0.028381] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations180gitlab # [ 0.028703] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations181gitlab # [ 0.030612] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations182gitlab # [ 0.030646] audit: initializing netlink subsys (disabled)183gitlab # [ 0.030988] audit: type=2000 audit(0.028:1): state=initialized audit_enabled=0 res=1184gitlab # [ 0.031563] thermal_sys: Registered thermal governor 'fair_share'185gitlab # [ 0.031567] thermal_sys: Registered thermal governor 'bang_bang'186gitlab # [ 0.031573] thermal_sys: Registered thermal governor 'step_wise'187gitlab # [ 0.031575] thermal_sys: Registered thermal governor 'user_space'188gitlab # [ 0.031578] thermal_sys: Registered thermal governor 'power_allocator'189gitlab # [ 0.031693] cpuidle: using governor ladder190gitlab # [ 0.031723] cpuidle: using governor menu191gitlab # [ 0.031950] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.192gitlab # [ 0.032182] ASID allocator initialised with 65536 entries193gitlab # [ 0.033344] Serial: AMBA PL011 UART driver194gitlab # [ 0.038889] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1195gitlab # [ 0.039223] printk: console [ttyAMA0] enabled196gitlab # [ 0.049847] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages197gitlab # [ 0.049869] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page198gitlab # [ 0.049879] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages199gitlab # [ 0.049887] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page200gitlab # [ 0.049895] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages201gitlab # [ 0.049903] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page202gitlab # [ 0.049912] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages203gitlab # [ 0.049920] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page204gitlab # [ 0.063829] fbcon: Taking over console205gitlab # [ 0.063848] ACPI: Interpreter disabled.206gitlab # [ 0.064937] iommu: Default domain type: Translated207gitlab # [ 0.064956] iommu: DMA domain TLB invalidation policy: strict mode208gitlab # [ 0.074566] SCSI subsystem initialized209gitlab # [ 0.075086] usbcore: registered new interface driver usbfs210gitlab # [ 0.075113] usbcore: registered new interface driver hub211gitlab # [ 0.075131] usbcore: registered new device driver usb212gitlab # [ 0.075439] pps_core: LinuxPPS API ver. 1 registered213gitlab # [ 0.075443] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>214gitlab # [ 0.075453] PTP clock support registered215gitlab # [ 0.075495] EDAC MC: Ver: 3.0.0216gitlab # [ 0.076077] scmi_core: SCMI protocol bus registered217gitlab # [ 0.077164] FPGA manager framework218gitlab # [ 0.078015] vgaarb: loaded219gitlab # [ 0.079899] clocksource: Switched to clocksource arch_sys_counter220gitlab # [ 0.097733] VFS: Disk quotas dquot_6.6.0221gitlab # [ 0.097815] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)222gitlab # [ 0.098444] netfs: FS-Cache loaded223gitlab # [ 0.098611] pnp: PnP ACPI: disabled224gitlab # [ 0.105953] NET: Registered PF_INET protocol family225gitlab # [ 0.107106] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)226gitlab # [ 0.138721] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)227gitlab # [ 0.138794] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)228gitlab # [ 0.138866] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)229gitlab # [ 0.139189] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)230gitlab # [ 0.139751] TCP: Hash tables configured (established 65536 bind 65536)231gitlab # [ 0.139961] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)232gitlab # [ 0.140034] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)233gitlab # [ 0.140182] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)234gitlab # [ 0.140416] NET: Registered PF_UNIX/PF_LOCAL protocol family235gitlab # [ 0.140469] NET: Registered PF_XDP protocol family236gitlab # [ 0.140489] PCI: CLS 0 bytes, default 64237gitlab # [ 0.140931] Trying to unpack rootfs image as initramfs...238gitlab # [ 0.152206] kvm [1]: HYP mode not available239gitlab # [ 0.201457] Initialise system trusted keyrings240gitlab # [ 0.201876] workingset: timestamp_bits=42 max_order=21 bucket_order=0241gitlab # [ 0.202735] squashfs: version 4.0 (2009/01/31) Phillip Lougher242gitlab # [ 0.202880] 9p: Installing v9fs 9p2000 file system support243gitlab # [ 0.214941] Key type asymmetric registered244gitlab # [ 0.214949] Asymmetric key parser 'x509' registered245gitlab # [ 0.215016] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)246gitlab # [ 0.215377] io scheduler mq-deadline registered247gitlab # [ 0.215394] io scheduler kyber registered248gitlab # [ 0.229255] pl061_gpio 9030000.pl061: PL061 GPIO chip registered249gitlab # [ 0.232051] ledtrig-cpu: registered to indicate activity on CPUs250gitlab # [ 0.232497] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:251gitlab # [ 0.232514] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000252gitlab # [ 0.232526] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000253gitlab # [ 0.232531] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000254gitlab # [ 0.232560] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits255gitlab # [ 0.232586] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]256gitlab # [ 0.232674] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00257gitlab # [ 0.232682] pci_bus 0000:00: root bus resource [bus 00-ff]258gitlab # [ 0.232686] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]259gitlab # [ 0.232689] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]260gitlab # [ 0.232693] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]261gitlab # [ 0.232807] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint262gitlab # [ 0.233368] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint263gitlab # [ 0.233594] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]264gitlab # [ 0.233607] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]265gitlab # [ 0.233633] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]266gitlab # [ 0.233645] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]267gitlab # [ 0.234211] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint268gitlab # [ 0.234451] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]269gitlab # [ 0.234463] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]270gitlab # [ 0.234489] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]271gitlab # [ 0.235054] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint272gitlab # [ 0.235286] pci 0000:00:03.0: BAR 0 [io 0x0000-0x001f]273gitlab # [ 0.235304] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]274gitlab # [ 0.235330] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]275gitlab # [ 0.235859] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint276gitlab # [ 0.236115] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]277gitlab # [ 0.236127] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]278gitlab # [ 0.236153] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]279gitlab # [ 0.236709] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint280gitlab # [ 0.236932] pci 0000:00:05.0: BAR 0 [io 0x0000-0x007f]281gitlab # [ 0.236943] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]282gitlab # [ 0.236970] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]283gitlab # [ 0.237552] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint284gitlab # [ 0.237768] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]285gitlab # [ 0.237780] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]286gitlab # [ 0.237806] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]287gitlab # [ 0.238387] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint288gitlab # [ 0.238612] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]289gitlab # [ 0.238624] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]290gitlab # [ 0.238652] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]291gitlab # [ 0.238664] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]292gitlab # [ 0.239213] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint293gitlab # [ 0.239436] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]294gitlab # [ 0.239462] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]295gitlab # [ 0.240060] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint296gitlab # [ 0.240275] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]297gitlab # [ 0.240301] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]298gitlab # [ 0.240773] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint299gitlab # [ 0.240991] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]300gitlab # [ 0.241288] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint301gitlab # [ 0.241579] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]302gitlab # [ 0.241597] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]303gitlab # [ 0.241630] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]304gitlab # [ 0.242198] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint305gitlab # [ 0.242417] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]306gitlab # [ 0.242429] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]307gitlab # [ 0.242456] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]308gitlab # [ 0.243105] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned309gitlab # [ 0.243112] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned310gitlab # [ 0.243116] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned311gitlab # [ 0.243162] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned312gitlab # [ 0.243212] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned313gitlab # [ 0.243263] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned314gitlab # [ 0.243314] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned315gitlab # [ 0.243362] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned316gitlab # [ 0.243412] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned317gitlab # [ 0.243463] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned318gitlab # [ 0.243514] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned319gitlab # [ 0.243565] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned320gitlab # [ 0.243630] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned321gitlab # [ 0.243681] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned322gitlab # [ 0.243703] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned323gitlab # [ 0.243727] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned324gitlab # [ 0.243750] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned325gitlab # [ 0.243771] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned326gitlab # [ 0.243789] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned327gitlab # [ 0.243811] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned328gitlab # [ 0.243835] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned329gitlab # [ 0.243854] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned330gitlab # [ 0.243873] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned331gitlab # [ 0.243912] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned332gitlab # [ 0.243938] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned333gitlab # [ 0.243957] pci 0000:00:05.0: BAR 0 [io 0x1000-0x107f]: assigned334gitlab # [ 0.243975] pci 0000:00:06.0: BAR 0 [io 0x1080-0x10ff]: assigned335gitlab # [ 0.243996] pci 0000:00:0b.0: BAR 0 [io 0x1100-0x113f]: assigned336gitlab # [ 0.244019] pci 0000:00:01.0: BAR 0 [io 0x1140-0x115f]: assigned337gitlab # [ 0.244042] pci 0000:00:02.0: BAR 0 [io 0x1160-0x117f]: assigned338gitlab # [ 0.244065] pci 0000:00:03.0: BAR 0 [io 0x1180-0x119f]: assigned339gitlab # [ 0.244088] pci 0000:00:04.0: BAR 0 [io 0x11a0-0x11bf]: assigned340gitlab # [ 0.244108] pci 0000:00:07.0: BAR 0 [io 0x11c0-0x11df]: assigned341gitlab # [ 0.244127] pci 0000:00:0c.0: BAR 0 [io 0x11e0-0x11ff]: assigned342gitlab # [ 0.244153] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]343gitlab # [ 0.244159] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]344gitlab # [ 0.244162] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]345gitlab # [ 0.245606] pci 0000:00:0a.0: enabling device (0000 -> 0002)346gitlab # [ 0.282616] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)347gitlab # [ 0.288690] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)348gitlab # [ 0.295611] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)349gitlab # [ 0.301413] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)350gitlab # [ 0.307808] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)351gitlab # [ 0.315239] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)352gitlab # [ 0.321405] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)353gitlab # [ 0.328471] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)354gitlab # [ 0.334517] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)355gitlab # [ 0.340943] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)356gitlab # [ 0.348215] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)357gitlab # [ 0.364175] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled358gitlab # [ 0.369401] msm_serial: driver initialized359gitlab # [ 0.369869] SuperH (H)SCI(F) driver initialized360gitlab # [ 0.370024] STM32 USART driver initialized361gitlab # [ 0.420122] loop: module loaded362gitlab # [ 0.420765] virtio_blk virtio4: 4/0/0 default/read/poll queues363gitlab # [ 0.426209] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)364gitlab # [ 0.431133] virtio_blk virtio5: 4/0/0 default/read/poll queues365gitlab # [ 0.436357] virtio_blk virtio5: [vdb] 12227528 512-byte logical blocks (6.26 GB/5.83 GiB)366gitlab # [ 0.441876] megasas: 07.734.00.00-rc1367gitlab # [ 0.443987] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]368gitlab # [ 0.453795] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000369gitlab # [ 0.453841] Intel/Sharp Extended Query Table at 0x0031370gitlab # [ 0.459402] Using buffer write method371gitlab # [ 0.459526] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]372gitlab # [ 0.463820] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000373gitlab # [ 0.463864] Intel/Sharp Extended Query Table at 0x0031374gitlab # [ 0.468605] Using buffer write method375gitlab # [ 0.468657] Concatenating MTD devices:376gitlab # [ 0.468675] (0): "0.flash"377gitlab # [ 0.468684] (1): "0.flash"378gitlab # [ 0.468689] into device "0.flash"379gitlab # [ 0.795938] Freeing initrd memory: 27184K380gitlab # [ 0.814182] tun: Universal TUN/TAP device driver, 1.6381gitlab # [ 0.823560] thunder_xcv, ver 1.0382gitlab # [ 0.823713] thunder_bgx, ver 1.0383gitlab # [ 0.823781] nicpf, ver 1.0384gitlab # [ 0.825834] e1000: Intel(R) PRO/1000 Network Driver385gitlab # [ 0.825851] e1000: Copyright (c) 1999-2006 Intel Corporation.386gitlab # [ 0.825917] e1000e: Intel(R) PRO/1000 Network Driver387gitlab # [ 0.825932] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.388gitlab # [ 0.825997] igb: Intel(R) Gigabit Ethernet Network Driver389gitlab # [ 0.826007] igb: Copyright (c) 2007-2014 Intel Corporation.390gitlab # [ 0.826091] igbvf: Intel(R) Gigabit Virtual Function Network Driver391gitlab # [ 0.826103] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.392gitlab # [ 0.826535] sky2: driver version 1.30393gitlab # [ 0.832094] usbcore: registered new interface driver usb-storage394gitlab # [ 0.832371] usbcore: registered new interface driver usbserial_generic395gitlab # [ 0.832424] usbserial: USB Serial support registered for generic396gitlab # [ 0.832486] ehci-pci 0000:00:0a.0: EHCI Host Controller397gitlab # [ 0.832557] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1398gitlab # [ 0.833222] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000399gitlab # [ 0.834676] hv_vmbus: registering driver hyperv_keyboard400gitlab # [ 0.837641] rtc-pl031 9010000.pl031: registered as rtc0401gitlab # [ 0.837710] rtc-pl031 9010000.pl031: setting system clock to 2026-08-16T17:00:51 UTC (1786899651)402gitlab # [ 0.838655] i2c_dev: i2c /dev entries driver403gitlab # [ 0.844013] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00404gitlab # [ 0.845410] hub 1-0:1.0: USB hub found405gitlab # [ 0.845623] hub 1-0:1.0: 6 ports detected406gitlab # [ 0.848439] sdhci: Secure Digital Host Controller Interface driver407gitlab # [ 0.848456] sdhci: Copyright(c) Pierre Ossman408gitlab # [ 0.849390] Synopsys Designware Multimedia Card Interface Driver409gitlab # [ 0.850637] sdhci-pltfm: SDHCI platform and OF driver helper410gitlab # [ 0.855811] hid: raw HID events driver (C) Jiri Kosina411gitlab # [ 0.856850] usbcore: registered new interface driver usbhid412gitlab # [ 0.856865] usbhid: USB HID core driver413gitlab # [ 0.890416] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available414gitlab # [ 0.895822] drop_monitor: Initializing network drop monitor service415gitlab # [ 0.896563] NET: Registered PF_INET6 protocol family416gitlab # [ 0.899307] Segment Routing with IPv6417gitlab # [ 0.899350] In-situ OAM (IOAM) with IPv6418gitlab # [ 0.899457] NET: Registered PF_PACKET protocol family419gitlab # [ 0.899825] 9pnet: Installing 9P2000 support420gitlab # [ 0.904391] Key type dns_resolver registered421gitlab # [ 0.924637] registered taskstats version 1422gitlab # [ 0.925246] Loading compiled-in X.509 certificates423gitlab # [ 0.952892] Demotion targets for Node 0: null424gitlab # [ 0.953195] Key type .fscrypt registered425gitlab # [ 0.953203] Key type fscrypt-provisioning registered426gitlab # [ 0.953456] ima: No TPM chip found, activating TPM-bypass!427gitlab # [ 0.953483] ima: Allocated hash algorithm: sha1428gitlab # [ 0.953616] ima: No architecture policies found429gitlab # [ 0.955168] input: gpio-keys as /devices/platform/gpio-keys/input/input0430gitlab # [ 0.987059] clk: Disabling unused clocks431gitlab # [ 0.987107] PM: genpd: Disabling unused power domains432gitlab # [ 0.993058] Freeing unused kernel memory: 4736K433gitlab # [ 0.993333] Run /init as init process434gitlab # [ 1.027431] systemd[1]: Successfully made /usr/ read-only.435gitlab # [ 1.104031] usb 1-1: new high-speed USB device number 2 using ehci-pci436gitlab # [ 1.261185] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1437gitlab # [ 1.348685] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0438gitlab # [ 1.362429] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)439gitlab # [ 1.362504] systemd[1]: Detected virtualization qemu.440gitlab # [ 1.362604] systemd[1]: Detected architecture arm64.441gitlab # [ 1.362622] systemd[1]: Running in initrd.442gitlab # [ 1.363700] systemd[1]: Initializing machine ID from random generator.443gitlab # [ 1.364194] systemd[1]: Hostname set to <gitlab>.444gitlab # [ 1.468010] usb 1-2: new high-speed USB device number 3 using ehci-pci445gitlab # [ 1.620600] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2446gitlab # [ 1.621124] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0447gitlab # [ 1.649085] systemd[1]: bpf-restrict-fs: LSM BPF program attached448gitlab # [ 1.741662] systemd[1]: Queued start job for default target Initrd Default Target.449gitlab # [ 1.763958] systemd[1]: Created slice Slice /system/modprobe.450gitlab # [ 1.764385] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.451gitlab # [ 1.764435] systemd[1]: Expecting device /dev/disk/by-label/nix-store...452gitlab # [ 1.764453] systemd[1]: Expecting device /dev/disk/by-label/nixos...453gitlab # [ 1.764486] systemd[1]: Reached target Path Units.454gitlab # [ 1.764507] systemd[1]: Reached target Slice Units.455gitlab # [ 1.764534] systemd[1]: Reached target Swaps.456gitlab # [ 1.764557] systemd[1]: Reached target Timer Units.457gitlab # [ 1.764849] systemd[1]: Listening on D-Bus System Message Bus Socket.458gitlab # [ 1.765055] systemd[1]: Listening on Journal Socket (/dev/log).459gitlab # [ 1.765250] systemd[1]: Listening on Journal Sockets.460gitlab # [ 1.765492] systemd[1]: Listening on udev Control Socket.461gitlab # [ 1.765618] systemd[1]: Listening on udev Kernel Socket.462gitlab # [ 1.765690] systemd[1]: Reached target Socket Units.463gitlab # [ 1.768535] systemd[1]: Starting Create List of Static Device Nodes...464gitlab # [ 1.770977] systemd[1]: Starting Load Kernel Module 9pnet_virtio...465gitlab # [ 1.771122] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs466gitlab # [ 1.773688] systemd[1]: Mounting Kernel Configuration File System...467gitlab # [ 1.804132] systemd[1]: Starting Journal Service...468gitlab # [ 1.807775] systemd[1]: Starting Load Kernel Modules...469gitlab # [ 1.808051] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os470gitlab # [ 1.812097] systemd[1]: Starting Coldplug All udev Devices...471gitlab # [ 1.814950] systemd[1]: Finished Create List of Static Device Nodes.472gitlab # [ 1.816967] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.473gitlab # [ 1.817587] systemd[1]: Finished Load Kernel Module 9pnet_virtio.474gitlab # [ 1.818009] systemd[1]: Mounted Kernel Configuration File System.475gitlab # [ 1.820450] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...476gitlab # [ 1.840363] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.477gitlab # [ 1.842453] systemd[1]: Starting Create Static Device Nodes in /dev...478gitlab # [ 1.858114] systemd[1]: Finished Create Static Device Nodes in /dev.479gitlab # [ 1.858317] systemd-journald[96]: Collecting audit messages is disabled.480gitlab # [ 1.858399] systemd[1]: Reached target Preparation for Local File Systems.481gitlab # [ 1.858429] systemd[1]: Reached target Local File Systems.482gitlab # [ 1.863039] systemd[1]: Starting Rule-based Manager for Device Events and Files...483gitlab # [ 1.891146] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0484gitlab # [ 1.891347] [drm] features: -virgl +edid -resource_blob -host_visible485gitlab # [ 1.891362] [drm] features: -context_init486gitlab # [ 1.893079] [drm] number of scanouts: 1487gitlab # [ 1.893111] [drm] number of cap sets: 0488gitlab # [ 1.902394] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.489gitlab # [ 1.903960] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev490gitlab # [ 1.908124] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic491gitlab # [ 1.908141] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0492gitlab # [ 1.915802] Console: switching to colour frame buffer device 160x50493gitlab # [ 1.916640] systemd[1]: Started Rule-based Manager for Device Events and Files.494gitlab # [ 1.922791] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device495gitlab # [ 1.944750] systemd[1]: Finished Load Kernel Modules.496gitlab # [ 1.948509] systemd[1]: Starting Apply Kernel Variables...497gitlab # [ 1.957322] systemd-modules-load[97]: Using 4 probe threads498gitlab # [ 1.958788] systemd-modules-load[97]: Module 'virtio_console' is built in[ 1.964424] systemd[1]: Starting Virtual Console Setup...499gitlab # 500gitlab # [ 1.965083] systemd[1]: Started Journal Service.501gitlab # [ 1.966823] systemd-modules-load[97]: Module 'virtio_balloon' is built in502gitlab # [ 1.968083] systemd-modules-load[97]: Module 'virtio_rng' is built in503gitlab # [ 1.971051] systemd-udevd[102]: Using default interface naming scheme 'v261'.504gitlab # [ 1.972978] systemd-modules-load[97]: Inserted module 'dm_mod'505gitlab # [ 1.976435] systemd-modules-load[97]: Inserted module 'virtio_gpu'506gitlab # [ 1.977794] systemd[1]: Starting Create System Files and Directories...507gitlab # [ 1.994027] systemd[1]: Finished Apply Kernel Variables.508gitlab # [ 2.005588] systemd[1]: Finished Create System Files and Directories.509gitlab # [ 2.012706] systemd-vconsole-setup[117]: Configuration of first virtual console was skipped, ignoring remaining ones.510gitlab # [ 2.016559] systemd[1]: Finished Virtual Console Setup.511gitlab # [ 2.613553] systemd[1]: Finished Coldplug All udev Devices.512gitlab # [ 3.098552] EXT4-fs (vda): mounted filesystem 1bb6c3c1-672c-42c6-b01f-2cbb21ba72b4 r/w with ordered data mode. Quota mode: none.513gitlab # [ 2.616420] systemd[1]: Reached target System Initialization.514gitlab # [ 3.241585] systemd[1]: Reached target Basic System.515gitlab # [ 3.242995] (udev-worker)[133]: Network interface NamePolicy= disabled on kernel command line.516gitlab # [ 3.244500] systemd-fsck[151]: nixos: clean, 12/65536 files, 13019/262144 blocks517gitlab # [ 3.246534] (udev-worker)[114]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.518gitlab # [ 3.248966] (udev-worker)[114]: Network interface NamePolicy= disabled on kernel command line.519gitlab # [ 3.250331] systemd[1]: Found device /dev/disk/by-label/nix-store.520gitlab # [ 3.251324] systemd[1]: Found device /dev/disk/by-label/nixos.521gitlab # [ 3.252325] systemd[1]: Reached target Initrd Root Device.522gitlab # [ 3.253210] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...523gitlab # [ 3.254321] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.524gitlab # [ 3.255283] systemd[1]: Mounting /sysroot...525gitlab # [ 3.255909] systemd[1]: Mounted /sysroot.526gitlab # [ 3.256616] systemd[1]: Reached target Initrd Root File System.527gitlab # [ 3.257448] systemd[1]: Mounting /sysroot/nix/.ro-store...528gitlab # [ 3.258220] systemd[1]: Mounting /sysroot/nix/.rw-store...529gitlab # [ 3.258983] systemd[1]: Mounting /sysroot/run...530gitlab # [ 3.259644] systemd[1]: Mounting /sysroot/tmp/shared...531gitlab # [ 3.260421] systemd[1]: Mounting /sysroot/tmp/xchg...532gitlab # [ 3.261129] systemd[1]: Starting Mountpoints Configured in the Real Root...533gitlab # [ 3.263400] systemd-sysroot-fstab-check[162]: /sysroot should be mounted in the initrd, will request daemon-reload.534gitlab # [ 3.265006] systemd[1]: Reload requested from client PID 162 ('systemd-sysroot') (unit initrd-parse-etc.service)...535gitlab # [ 3.266526] systemd[1]: Reloading...536gitlab # [ 3.276129] erofs (device vdb): mounted with root inode @ nid 128.537gitlab # [ 3.344547] systemd[1]: Reloading finished in 203 ms.538gitlab # [ 3.391368] systemd-sysroot-fstab-check[162]: Requesting initrd-fs.target/start/replace...539gitlab # [ 3.394020] systemd[1]: Mounted /sysroot/nix/.ro-store.540gitlab # [ 3.394870] systemd[1]: Mounted /sysroot/nix/.rw-store.541gitlab # [ 3.395647] systemd[1]: Mounted /sysroot/run.542gitlab # [ 3.396343] systemd[1]: Mounted /sysroot/tmp/shared.543gitlab # [ 3.397095] systemd[1]: Mounted /sysroot/tmp/xchg.544gitlab # [ 3.400213] systemd-sysroot-fstab-check[162]: Requesting swap.target/start/replace...545gitlab # [ 3.409019] systemd[1]: Starting rw-sysroot-nix-store.service...546gitlab # [ 3.410112] systemd[1]: initrd-parse-etc.service: Deactivated successfully.547gitlab # [ 3.411102] systemd[1]: Finished Mountpoints Configured in the Real Root.548gitlab # [ 3.412158] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.549gitlab # [ 3.427677] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.550gitlab # [ 3.429115] systemd[1]: Finished rw-sysroot-nix-store.service.551gitlab # [ 3.543915] (udev-worker)[144]: mtd0ro: Failed to find and pin callout binary "/nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/mtd_probe": No such file or directory552gitlab # [ 3.547570] (udev-worker)[144]: mtd0ro: /nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory553gitlab # [ 3.553181] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.554gitlab # [ 3.554577] systemd[1]: Stopped Virtual Console Setup.555gitlab # [ 3.555698] systemd[1]: Stopping Virtual Console Setup...556gitlab # [ 3.556612] systemd[1]: Starting Virtual Console Setup...557gitlab # [ 3.576988] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.558gitlab # [ 3.578222] systemd[1]: Stopped Virtual Console Setup.559gitlab # [ 3.578982] systemd[1]: Starting Virtual Console Setup...560gitlab # [ 3.604785] systemd-vconsole-setup[193]: Configuration of first virtual console was skipped, ignoring remaining ones.561gitlab # [ 3.606813] systemd[1]: Finished Virtual Console Setup.562gitlab # [ 3.820220] systemd[1]: Mounting /sysroot/nix/store...563gitlab # [ 3.907621] systemd[1]: Mounted /sysroot/nix/store.564gitlab # [ 3.910424] systemd[1]: Reached target Initrd File Systems.565gitlab # [ 3.915501] systemd[1]: Starting Find NixOS closure...566gitlab # [ 3.920287] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...567gitlab # [ 3.977239] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.568gitlab # [ 3.982852] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.569gitlab # [ 4.007469] systemd[1]: Finished Find NixOS closure.570gitlab # [ 4.010007] systemd[1]: Reached target Initrd Default Target.571gitlab # [ 4.012585] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...572gitlab # [ 4.093751] systemd[1]: Stopped target Initrd Default Target.573gitlab # [ 4.096599] systemd[1]: Stopped target Basic System.574gitlab # [ 4.098788] systemd[1]: Stopped target Initrd Root Device.575gitlab # [ 4.101319] systemd[1]: Stopped target Path Units.576gitlab # [ 4.103463] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.577gitlab # [ 4.106875] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.578gitlab # [ 4.110253] systemd[1]: Stopped target Slice Units.579gitlab # [ 4.112493] systemd[1]: Stopped target Socket Units.580gitlab # [ 4.114647] systemd[1]: Stopped target System Initialization.581gitlab # [ 4.117214] systemd[1]: Stopped target Swaps.582gitlab # [ 4.119186] systemd[1]: Stopped target Timer Units.583gitlab # [ 4.124609] systemd[1]: dbus.socket: Deactivated successfully.584gitlab # [ 4.127116] systemd[1]: Closed D-Bus System Message Bus Socket.585gitlab # [ 4.129844] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.586gitlab # [ 4.133089] systemd[1]: Stopped Find NixOS closure.587gitlab # [ 4.135237] systemd[1]: Starting Load Kernel Module 9pnet_virtio...588gitlab # [ 4.138057] systemd[1]: Starting rw-sysroot-nix-store.service...589gitlab # [ 4.140862] systemd[1]: systemd-sysctl.service: Deactivated successfully.590gitlab # [ 4.144275] systemd[1]: Stopped Apply Kernel Variables.591gitlab # [ 4.146826] systemd[1]: systemd-modules-load.service: Deactivated successfully.592gitlab # [ 4.149886] systemd[1]: Stopped Load Kernel Modules.593gitlab # [ 4.151879] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.594gitlab # [ 4.155137] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.595gitlab # [ 4.157995] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.596gitlab # [ 4.160666] systemd[1]: Stopped Create System Files and Directories.597gitlab # [ 4.163812] systemd[1]: Stopped target Local File Systems.598gitlab # [ 4.165884] systemd[1]: Stopped target Preparation for Local File Systems.599gitlab # [ 4.168150] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.600gitlab # [ 4.170502] systemd[1]: Stopped Coldplug All udev Devices.601gitlab # [ 4.172425] systemd[1]: Stopping Rule-based Manager for Device Events and Files...602gitlab # [ 4.174822] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.603gitlab # [ 4.177298] systemd[1]: Stopped Virtual Console Setup.604gitlab # [ 4.179059] systemd[1]: initrd-cleanup.service: Deactivated successfully.605gitlab # [ 4.181450] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.606gitlab # [ 4.183654] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.607gitlab # [ 4.186100] systemd[1]: Finished rw-sysroot-nix-store.service.608gitlab # [ 4.187949] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.609gitlab # [ 4.190168] systemd[1]: Finished Load Kernel Module 9pnet_virtio.610gitlab # [ 4.192139] systemd[1]: systemd-udevd.service: Deactivated successfully.611gitlab # [ 4.194158] systemd[1]: Stopped Rule-based Manager for Device Events and Files.612gitlab # [ 4.196341] systemd[1]: systemd-udevd.service: Consumed 2.575s CPU time over 2.303s wall clock time, 31.1M memory peak.613gitlab # [ 4.199417] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.614gitlab # [ 4.201730] systemd[1]: Closed udev Control Socket.615gitlab # [ 4.203344] systemd[1]: Starting Cleanup udev Database...616gitlab # [ 4.205389] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.617gitlab # [ 4.207573] systemd[1]: Stopped Create Static Device Nodes in /dev.618gitlab # [ 4.209489] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.619gitlab # [ 4.211649] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.620gitlab # [ 4.213661] systemd[1]: kmod-static-nodes.service: Deactivated successfully.621gitlab # [ 4.215394] systemd[1]: Stopped Create List of Static Device Nodes.622gitlab # [ 4.284188] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.623gitlab # [ 4.287430] systemd[1]: Finished Cleanup udev Database.624gitlab # [ 4.289886] systemd[1]: Reached target Switch Root.625gitlab # [ 4.292044] systemd[1]: Starting NixOS Activation...626gitlab # [ 4.493219] initrd-nixos-activation-start[220]: booting system configuration /nix/store/4cz564bp70gwwkqhzfnzcvrknb17cnh9-nixos-system-gitlab-test627gitlab # [ 4.566165] initrd-nixos-activation-start[220]: running activation script...628gitlab # [ 4.953450] initrd-nixos-activation-start[243]: setting up /etc...629gitlab # [ 5.171760] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.630gitlab # [ 5.175716] systemd[1]: Finished NixOS Activation.631gitlab # [ 5.180402] systemd[1]: Starting Switch Root...632gitlab # [ 5.265193] systemd[1]: Switching root.633gitlab # [ 5.417655] systemd-journald[96]: Received SIGTERM from PID 1 (systemd).634gitlab # [ 6.180659] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)635gitlab # [ 6.180858] systemd[1]: Detected virtualization qemu.636gitlab # [ 6.181192] systemd[1]: Detected architecture arm64.637gitlab # [ 6.181648] systemd[1]: Detected first boot.638gitlab # [ 6.185520] systemd[1]: Initializing machine ID from random generator.639gitlab # [ 6.538121] systemd[1]: bpf-restrict-fs: LSM BPF program attached640gitlab # [ 6.673576] systemd[1]: Applying preset policy.641gitlab # [ 6.874286] systemd[1]: Populated /etc with preset unit settings.642gitlab # [ 7.031584] systemd[1]: initrd-switch-root.service: Deactivated successfully.643gitlab # [ 7.032119] systemd[1]: Stopped initrd-switch-root.service.644gitlab # [ 7.034854] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.645gitlab # [ 7.040620] systemd[1]: Created slice Slice /system/getty.646gitlab # [ 7.049640] systemd[1]: Created slice GitLab DevOps Platform Slice.647gitlab # [ 7.053744] systemd[1]: Created slice User and Session Slice.648gitlab # [ 7.058212] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.649gitlab # [ 7.059969] systemd[1]: Started Forward Password Requests to Wall Directory Watch.650gitlab # [ 7.061329] systemd[1]: Expecting device /dev/hvc0...651gitlab # [ 7.062569] systemd[1]: Expecting device /dev/ttyAMA0...652gitlab # [ 7.063861] systemd[1]: Reached target Local Encrypted Volumes.653gitlab # [ 7.065276] systemd[1]: Stopped target initrd-fs.target.654gitlab # [ 7.066534] systemd[1]: Stopped target initrd-root-fs.target.655gitlab # [ 7.067808] systemd[1]: Stopped target initrd-switch-root.target.656gitlab # [ 7.069147] systemd[1]: Reached target Virtual Machines and Containers.657gitlab # [ 7.070516] systemd[1]: Reached target Path Units.658gitlab # [ 7.071797] systemd[1]: Reached target Remote File Systems.659gitlab # [ 7.073112] systemd[1]: Reached target Slice Units.660gitlab # [ 7.074369] systemd[1]: Reached target Swaps.661gitlab # [ 7.078924] systemd[1]: Listening on Query the User Interactively for a Password.662gitlab # [ 7.083708] systemd[1]: Listening on Process Core Dump Socket.663gitlab # [ 7.087144] systemd[1]: Listening on Credential Encryption/Decryption.664gitlab # [ 7.091089] systemd[1]: Listening on Factory Reset Management.665gitlab # [ 7.092510] systemd[1]: Listening on Hostname Service Socket.666gitlab # [ 7.102615] systemd[1]: Starting Journal Log Access Socket...667gitlab # [ 7.104673] systemd[1]: Listening on Journal Audit Socket.668gitlab # [ 7.108328] systemd[1]: Listening on Console Output Muting Service Socket.669gitlab # [ 7.109723] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.670gitlab # [ 7.110715] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os671gitlab # [ 7.111582] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki672gitlab # [ 7.116925] systemd[1]: Listening on Disk Repartitioning Service Socket.673gitlab # [ 7.118152] systemd[1]: Listening on udev Control Socket.674gitlab # [ 7.119337] systemd[1]: Listening on udev Varlink Socket.675gitlab # [ 7.161540] systemd[1]: Mounting Huge Pages File System...676gitlab # [ 7.167826] systemd[1]: Mounting POSIX Message Queue File System...677gitlab # [ 7.175661] systemd[1]: Mounting Kernel Debug File System...678gitlab # [ 7.184267] systemd[1]: Mounting Kernel Trace File System...679gitlab # [ 7.192585] systemd[1]: Starting Create List of Static Device Nodes...680gitlab # [ 7.200522] systemd[1]: Starting Load Kernel Module 9pnet_virtio...681gitlab # [ 7.202367] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs682gitlab # [ 7.221004] systemd[1]: Mounting Kernel Configuration File System...683gitlab # [ 7.224228] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm684gitlab # [ 7.225353] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore685gitlab # [ 7.239194] systemd[1]: Starting Load Kernel Module fuse...686gitlab # [ 7.240357] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67687gitlab # [ 7.252836] systemd[1]: Starting Journal Service...688gitlab # [ 7.258611] systemd[1]: Starting Load Kernel Modules...689gitlab # [ 7.270876] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...690gitlab # [ 7.281729] fuse: init (API version 7.45)691gitlab # [ 7.285076] systemd[1]: Starting Remount Root and Kernel File Systems...692gitlab # [ 7.288797] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os693gitlab # [ 7.294233] systemd-journald[314]: Collecting audit messages is enabled.694gitlab # [ 7.300439] systemd[1]: Starting Coldplug All udev Devices...695gitlab # [ 7.313733] systemd[1]: Listening on Journal Log Access Socket.696gitlab # [ 7.314822] systemd[1]: Mounted Huge Pages File System.697gitlab # [ 7.316047] systemd[1]: Mounted POSIX Message Queue File System.698gitlab # [ 7.316917] systemd[1]: Mounted Kernel Debug File System.699gitlab # [ 7.324739] systemd[1]: Started Journal Service.700gitlab # [ 7.320572] systemd[1]: Queued start job for default target Multi-User System.701gitlab # [ 7.327062] systemd[1]: Unnecessary job was removed for /dev/vdb.702gitlab # [ 7.328359] systemd[1]: systemd-journald.service: Deactivated successfully.703gitlab # [ 7.329963] systemd-modules-load[315]: Using 3 probe threads704gitlab # [ 7.331037] systemd-modules-load[315]: Module 'atkbd' is built in705gitlab # [ 7.332154] systemd-modules-load[315]: Module 'loop' is built in706gitlab # [ 7.333261] systemd[1]: Mounted Kernel Trace File System.707gitlab # [ 7.334291] systemd[1]: Finished Create List of Static Device Nodes.708gitlab # [ 7.335593] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.709gitlab # [ 7.336972] systemd[1]: Finished Load Kernel Module 9pnet_virtio.710gitlab # [ 7.338755] systemd[1]: Mounted Kernel Configuration File System.711gitlab # [ 7.339839] systemd[1]: modprobe@fuse.service: Deactivated successfully.712gitlab # [ 7.341028] systemd[1]: Finished Load Kernel Module fuse.713gitlab # [ 7.341933] systemd-modules-load[315]: Inserted module 'tls'714gitlab # [ 7.342805] systemd[1]: Finished Load Kernel Modules.715gitlab # [ 7.348081] EXT4-fs (vda): re-mounted 1bb6c3c1-672c-42c6-b01f-2cbb21ba72b4.716gitlab # [ 7.346639] systemd[1]: Mounting FUSE Control File System...717gitlab # [ 7.353007] systemd[1]: Starting Firewall...718gitlab # [ 7.355947] systemd-oomd[317]: No swap; memory pressure usage will be degraded719gitlab # [ 7.361273] systemd[1]: Starting Apply Kernel Variables...720gitlab # [ 7.364409] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...721gitlab # [ 7.369181] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.722gitlab # [ 7.371680] systemd[1]: Finished Remount Root and Kernel File Systems.723gitlab # [ 7.375776] systemd[1]: Mounted FUSE Control File System.724gitlab # [ 7.379384] systemd[1]: Listening on Disk Image Download Service Socket.725gitlab # [ 7.388776] systemd[1]: Starting Flush Journal to Persistent Storage...726gitlab # [ 7.390416] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore727gitlab # [ 7.396354] systemd[1]: Starting Load/Save OS Random Seed...728gitlab # [ 7.398918] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os729gitlab # [ 7.400755] systemd[1]: Finished Apply Kernel Variables.730gitlab # [ 7.417835] systemd-journald[314]: Received client request to flush runtime journal.731gitlab # [ 7.448749] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.732gitlab # [ 7.452446] systemd[1]: Starting Create Static Device Nodes in /dev...733gitlab # [ 7.454163] systemd[1]: Finished Load/Save OS Random Seed.734gitlab # [ 7.455059] systemd[1]: Reached target First Boot Complete.735gitlab # [ 7.455856] systemd[1]: Finished Create Static Device Nodes in /dev.736gitlab # [ 7.456840] systemd[1]: Reached target Preparation for Local File Systems.737gitlab # [ 7.457842] systemd[1]: Starting Rule-based Manager for Device Events and Files...738gitlab # [ 7.458876] systemd[1]: Finished Flush Journal to Persistent Storage.739gitlab # [ 7.541193] systemd-udevd[356]: Using default interface naming scheme 'v261'.740gitlab # [ 7.578851] systemd[1]: Started Rule-based Manager for Device Events and Files.741gitlab # [ 7.959568] systemd[1]: Finished Firewall.742gitlab # [ 7.997439] systemd[1]: Finished Coldplug All udev Devices.743gitlab # [ 8.036062] systemd[1]: Mounting /run/wrappers...744gitlab # [ 8.069751] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs745gitlab # [ 8.076991] systemd[1]: Mounted /run/wrappers.746gitlab # [ 8.080932] systemd[1]: Reached target Local File Systems.747gitlab # [ 8.083488] systemd[1]: Listening on Boot Loader Control Service Socket.748gitlab # [ 8.094552] systemd[1]: Starting register-nix-paths.service...749gitlab # [ 8.096528] systemd[1]: Starting Create SUID/SGID Wrappers...750gitlab # [ 8.099327] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.751gitlab # [ 8.119457] systemd[1]: Starting Save Transient machine-id to Disk...752gitlab # [ 8.128708] systemd[1]: Starting Create System Files and Directories...753gitlab # [ 8.184558] systemd[1]: Finished Create System Files and Directories.754gitlab # [ 8.190049] systemd[1]: Starting Rebuild Journal Catalog...755gitlab # [ 8.195686] systemd[1]: Starting Record System Boot/Shutdown in UTMP...756gitlab # [ 8.229068] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.757gitlab # [ 8.233177] systemd[1]: Finished Save Transient machine-id to Disk.758gitlab # [ 8.251106] systemd[1]: Finished Record System Boot/Shutdown in UTMP.759gitlab # [ 8.254703] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.760gitlab # [ 8.264372] systemd[1]: Finished Rebuild Journal Catalog.761gitlab # [ 8.268362] systemd[1]: Starting Update is Completed...762gitlab # [ 8.276392] (udev-worker)[401]: Network interface NamePolicy= disabled on kernel command line.763gitlab # [ 8.298010] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped.764gitlab # [ 8.302614] (udev-worker)[474]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.765gitlab # [ 8.308572] (udev-worker)[474]: Network interface NamePolicy= disabled on kernel command line.766gitlab # [ 8.323437] systemd[1]: Finished Update is Completed.767gitlab # [ 8.334797] systemd[1]: Condition check resulted in Virtio network device being skipped.768gitlab # [ 8.337462] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore769gitlab # [ 8.339146] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.770gitlab # [ 8.340558] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67771gitlab # [ 8.342913] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore772gitlab # [ 8.347713] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os773gitlab # [ 8.349525] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os774gitlab # [ 8.421293] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.775gitlab # [ 8.423393] systemd[1]: Finished Create SUID/SGID Wrappers.776gitlab # [ 8.424611] systemd[1]: suid-sgid-wrappers.service: Consumed 208ms CPU time over 325ms wall clock time, 6.1M memory peak, 1.9M read from disk.777gitlab # [ 8.460094] mousedev: PS/2 mouse device common for all mice778gitlab # [ 8.666287] systemd[1]: Finished register-nix-paths.service.779gitlab # [ 8.668610] systemd[1]: Reached target System Initialization.780gitlab # [ 8.670077] systemd[1]: Started Discard unused filesystem blocks once a week.781gitlab # [ 8.671668] systemd[1]: Started logrotate.timer.782gitlab # [ 8.673094] systemd[1]: Started Daily Cleanup of Temporary Directories.783gitlab # [ 8.674169] systemd[1]: Reached target Timer Units.784gitlab # [ 8.674965] systemd[1]: Listening on D-Bus System Message Bus Socket.785gitlab # [ 8.675918] systemd[1]: Listening on Nix Daemon Socket.786gitlab # [ 8.686728] systemd[1]: Starting nixbot CI service socket...787gitlab # [ 8.688165] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.788gitlab # [ 8.689454] systemd[1]: Listening on nixbot CI service socket.789gitlab # [ 8.690327] systemd[1]: Reached target Socket Units.790gitlab # [ 8.692558] systemd[1]: Starting D-Bus System Message Bus...791gitlab # [ 8.743289] dbus-broker-launch[559]: Looking up NSS user entry for 'systemd-timesync'...792gitlab # [ 8.746634] dbus-broker-launch[559]: NSS returned no entry for 'systemd-timesync'793gitlab # [ 8.748515] dbus-broker-launch[559]: Invalid user-name in /nix/store/9zcyylhndlnizbwn48627991zr1jxg4p-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"794gitlab # [ 8.750963] systemd[1]: Started D-Bus System Message Bus.795gitlab # [ 8.763533] dbus-broker-launch[559]: Ready796gitlab # [ 8.765361] systemd[1]: Reached target Basic System.797gitlab # [ 8.768414] systemd[1]: Started backdoor.service.798gitlab # [ 8.772982] systemd[1]: Starting gitlab-config.service...799gitlab # [ 8.793720] systemd[1]: Starting Import lastlog data into lastlog2 database...800gitlab # [ 8.804511] systemd[1]: Starting Logrotate configuration check...801gitlab # connecting to host...802gitlab # [ 8.811478] systemd[1]: Starting Name Service Cache Daemon (nsncd)...803gitlab # [ 8.820659] systemd[1]: Starting Post-Boot Actions...804gitlab: Guest shell says: b'Spawning backdoor root shell...\n'805gitlab # [ 8.835221] systemd[1]: Started Reset console on configuration changes.806gitlab # [ 8.836977] logrotate[566]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.807gitlab: connected to guest root shell808gitlab # [ 8.838844] logrotate[566]: reading config file /nix/store/22afkmbkaxyx50bj9lbkkpmz7pd69hsf-logrotate.conf809gitlab: (connecting took 9.33 seconds)810gitlab # [ 8.840117] logrotate[566]: note: 'monthly' overrides previously specified 'weekly'811gitlab: (finished: waiting for the VM to finish booting, in 9.33 seconds)812gitlab # [ 8.841097] logrotate[566]: Reading state from file: /var/lib/logrotate.status813gitlab # [ 8.841983] logrotate[566]: state file /var/lib/logrotate.status does not exist814gitlab # [ 8.842932] logrotate[566]: Allocating hash table for state file, size 64 entries815gitlab # [ 8.843929] logrotate[566]: Handling 4 logs816gitlab # [ 8.848368] logrotate[566]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed817gitlab # [ 8.850654] logrotate[566]: considering log /var/log/btmp818gitlab # [ 8.851466] logrotate[566]: Creating new state819gitlab # [ 8.852847] logrotate[566]: Now: 2026-08-16 17:00820gitlab # [ 8.853585] logrotate[566]: Last rotated at 2026-08-16 17:00821gitlab # [ 8.854371] logrotate[566]: log does not need rotating (log has already been rotated)822gitlab # [ 8.855422] logrotate[566]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed823gitlab # [ 8.858045] logrotate[566]: considering log /var/log/wtmp824gitlab # [ 8.860288] logrotate[566]: Creating new state825gitlab # [ 8.861635] logrotate[566]: Now: 2026-08-16 17:00826gitlab # [ 8.862363] logrotate[566]: Last rotated at 2026-08-16 17:00827gitlab # [ 8.864337] logrotate[566]: log does not need rotating (log has already been rotated)828gitlab # [ 8.865598] logrotate[566]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed829gitlab # [ 8.872269] logrotate[566]: switching euid from 0 to 165 and egid from 0 to 165 (pid 566)830gitlab # [ 8.873497] logrotate[566]: considering log /var/gitlab/state/log/*.log831gitlab # [ 8.874366] logrotate[566]: log /var/gitlab/state/log/*.log does not exist -- skipping832gitlab # [ 8.875576] logrotate[566]: Creating new state833gitlab # [ 8.878578] logrotate[566]: switching euid from 165 to 0 and egid from 165 to 0 (pid 566)834gitlab # [ 8.879818] logrotate[566]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed835gitlab # [ 8.885854] logrotate[566]: switching euid from 0 to 60 and egid from 0 to 60 (pid 566)836gitlab # [ 8.887132] logrotate[566]: considering log /var/log/nginx/*.log837gitlab # [ 8.887941] logrotate[566]: log /var/log/nginx/*.log does not exist -- skipping838gitlab # [ 8.892196] logrotate[566]: Creating new state839gitlab # [ 8.892943] logrotate[566]: not running postrotate script, since no logs were rotated840gitlab # [ 8.894026] logrotate[566]: switching euid from 60 to 0 and egid from 60 to 0 (pid 566)841gitlab # [ 8.900313] systemd[1]: Starting resolvconf update...842gitlab # [ 8.901656] systemd[1]: Started Name Service Cache Daemon (nsncd).843gitlab # [ 8.902857] systemd[1]: Finished Logrotate configuration check.844gitlab # [ 8.903924] systemd[1]: Finished Post-Boot Actions.845gitlab # [ 8.914140] nsncd[567]: Aug 16 17:00:59.579 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"846gitlab # [ 8.917802] systemd[1]: Finished Import lastlog data into lastlog2 database.847gitlab # [ 8.919453] systemd[1]: Reached target Host and Network Name Lookups.848gitlab # [ 8.921647] systemd[1]: Reached target User and Group Name Lookups.849gitlab # [ 8.932733] systemd[1]: Starting User Login Management...850gitlab # [ 8.981323] systemd[1]: Stopped target Host and Network Name Lookups.851gitlab # [ 8.984284] systemd[1]: Stopping Host and Network Name Lookups...852gitlab # [ 8.985285] systemd[1]: Stopped target User and Group Name Lookups.853gitlab # [ 8.986236] systemd[1]: Stopping User and Group Name Lookups...854gitlab # [ 8.992861] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...855gitlab # [ 8.994209] systemd[1]: nscd.service: Deactivated successfully.856gitlab # [ 8.996173] systemd[1]: Stopped Name Service Cache Daemon (nsncd).857gitlab # [ 8.997236] systemd[1]: nscd.service: Consumed 35ms CPU time over 180ms wall clock time, 7.3M memory peak, 5.8M read from disk.858gitlab # [ 9.009356] systemd-logind[617]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)859gitlab # [ 9.011476] systemd-logind[617]: Watching system buttons on /dev/input/event0 (gpio-keys)860gitlab # [ 9.012987] systemd-logind[617]: New seat seat0.861gitlab # [ 9.015282] systemd[1]: Starting Name Service Cache Daemon (nsncd)...862gitlab # [ 9.021492] systemd[1]: Started User Login Management.863gitlab # [ 9.042558] systemd[1]: Starting linger-users.service...864gitlab # [ 9.044140] systemd[1]: Finished resolvconf update.865gitlab # [ 9.045832] systemd[1]: Reached target Preparation for Network.866gitlab # [ 9.060641] nsncd[658]: Aug 16 17:00:59.724 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"867gitlab # [ 9.068333] systemd[1]: Starting DHCP Client...868gitlab # [ 9.071561] systemd[1]: Starting Address configuration of eth1...869gitlab # [ 9.080876] systemd[1]: Starting Extra networking commands....870gitlab # [ 9.083798] systemd[1]: Started Name Service Cache Daemon (nsncd).871gitlab # [ 9.086756] systemd[1]: linger-users.service: Deactivated successfully.872gitlab # [ 9.096519] systemd[1]: Finished linger-users.service.873gitlab # [ 9.102529] systemd[1]: Reached target Host and Network Name Lookups.874gitlab # [ 9.103752] systemd[1]: Reached target User and Group Name Lookups.875gitlab # [ 9.137024] network-addresses-eth1-start[681]: adding address 192.168.1.1/24... done876gitlab # [ 9.146434] network-addresses-eth1-start[681]: adding address 2001:db8:1::1/64... done877gitlab # [ 9.161896] systemd[1]: Finished Address configuration of eth1.878gitlab # [ 9.276289] systemd[1]: Finished Extra networking commands..879gitlab # [ 9.281320] systemd[1]: Reached target Network.880gitlab # [ 9.291574] dhcpcd[709]: dhcpcd-10.3.2 starting881gitlab # [ 9.292616] systemd[1]: Starting gitlab-workhorse.service...882gitlab # [ 9.297448] systemd[1]: Starting Nginx Web Server...883gitlab # [ 9.304028] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3884gitlab # [ 9.303599] dhcpcd[750]: dev: loaded udev885gitlab # [ 9.322318] 8021q: 802.1Q VLAN Support v1.8886gitlab # [ 9.322780] 8021q: adding VLAN 0 to HW filter on device eth1887gitlab # [ 9.324730] systemd[1]: Starting PostgreSQL Server...888gitlab # [ 9.330200] systemd[1]: Starting Redis Server - redis-gitlab...889gitlab # [ 9.340340] systemd[1]: Starting Permit User Sessions...890gitlab # [ 9.384696] systemd[1]: Finished Permit User Sessions.891gitlab # [ 9.395046] systemd[1]: Started Getty on tty1.892gitlab # [ 9.403504] systemd[1]: Reached target Login Prompts.893gitlab # [ 9.436630] cfg80211: Loading compiled-in X.509 certificates for regulatory database894gitlab # [ 9.451443] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'895gitlab # [ 9.453035] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'896gitlab # [ 9.454950] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2897gitlab # [ 9.455309] cfg80211: failed to load regulatory.db898gitlab # [ 9.519699] nginx-pre-start[773]: nginx: the configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf syntax is ok899gitlab # [ 9.522421] nginx-pre-start[773]: nginx: configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf test is successful900gitlab # [ 9.533865] systemd[1]: Started Nginx Web Server.901gitlab # [ 9.564726] 8021q: adding VLAN 0 to HW filter on device eth0902gitlab # [ 9.566303] dhcpcd[750]: eth0: waiting for carrier903gitlab # [ 9.570187] dhcpcd[750]: eth0: carrier acquired904gitlab # [ 9.570998] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.905gitlab # [ 9.580242] systemd-logind[617]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)906gitlab # [ 9.581731] dhcpcd[750]: DUID 00:01:00:01:32:14:a9:4c:52:54:00:12:34:56907gitlab # [ 9.582799] systemd[1]: Starting Virtual Console Setup...908gitlab # [ 9.583884] dhcpcd[750]: eth0: IAID 00:12:34:56909gitlab # [ 9.584763] dhcpcd[750]: eth0: adding address fe80::5054:ff:fe12:3456910gitlab # [ 9.587386] postgresql-pre-start[779]: The files belonging to this database system will be owned by user "postgres".911gitlab # [ 9.589893] postgresql-pre-start[779]: This user must also own the server process.912gitlab # [ 9.591397] postgresql-pre-start[779]: The database cluster will be initialized with locale "en_US.UTF-8".913gitlab # [ 9.593019] postgresql-pre-start[779]: The default database encoding has accordingly been set to "UTF8".914gitlab # [ 9.594330] postgresql-pre-start[779]: The default text search configuration will be set to "english".915gitlab # [ 9.595649] postgresql-pre-start[779]: Data page checksums are enabled.916gitlab # [ 9.596645] postgresql-pre-start[779]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok917gitlab # [ 9.598069] postgresql-pre-start[779]: creating subdirectories ... ok918gitlab # [ 9.598973] postgresql-pre-start[779]: selecting dynamic shared memory implementation ... posix919gitlab # [ 9.645007] postgresql-pre-start[779]: selecting default "max_connections" ... 100920gitlab # [ 9.684671] systemd-vconsole-setup[794]: Configuration of first virtual console was skipped, ignoring remaining ones.921gitlab # [ 9.691110] systemd[1]: Finished Virtual Console Setup.922gitlab # [ 9.712230] postgresql-pre-start[779]: selecting default "shared_buffers" ... 128MB923gitlab # [ 9.729758] redis-server[787]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.924gitlab # [ 9.731898] redis-server[787]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo925gitlab # [ 9.734804] redis-server[787]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=787, just started926gitlab # [ 9.736700] redis-server[787]: Configuration loaded927gitlab # [ 9.737665] redis[787]: monotonic clock: ARM CNTVCT @ 1000 ticks/us928gitlab # [ 9.738819] systemd[1]: Started Redis Server - redis-gitlab.929gitlab # [ 9.739811] redis[787]: Running mode=standalone, port=0.930gitlab # [ 9.740928] redis[787]: Server initialized931gitlab # [ 9.741878] redis[787]: Ready to accept connections unix932gitlab # [ 9.742925] redis[787]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.933gitlab # [ 10.228366] systemd[1]: Started gitlab-workhorse.service.934gitlab # [ 10.229400] postgresql-pre-start[779]: selecting default time zone ... UTC935gitlab # [ 10.232120] postgresql-pre-start[779]: creating configuration files ... ok936gitlab # [ 10.454860] postgresql-pre-start[779]: running bootstrap script ... ok937gitlab # [ 10.482748] gitlab-workhorse[825]: time="2026-08-16T17:01:01Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4938gitlab # [ 10.484715] gitlab-workhorse[825]: time="2026-08-16T17:01:01Z" level=info msg="Using redis/go-redis"939gitlab # [ 10.486160] gitlab-workhorse[825]: time="2026-08-16T17:01:01Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix940gitlab # [ 11.158730] postgresql-pre-start[779]: performing post-bootstrap initialization ... ok941gitlab # [ 11.446794] dhcpcd[750]: eth0: soliciting an IPv6 router942gitlab # [ 11.449806] dhcpcd[750]: eth0: Router Advertisement from fe80::2943gitlab # [ 11.452793] dhcpcd[750]: eth0: adding address fec0::5054:ff:fe12:3456/64944gitlab # [ 11.456186] dhcpcd[750]: eth0: adding route to fec0::/64945gitlab # [ 11.458893] dhcpcd[750]: eth0: adding default route via fe80::2946gitlab # [ 11.481243] postgresql-pre-start[779]: syncing data to disk ... ok947gitlab # [ 11.483973] postgresql-pre-start[779]: initdb: warning: enabling "trust" authentication for local connections948gitlab # [ 11.488221] postgresql-pre-start[779]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.949gitlab # [ 11.495013] postgresql-pre-start[779]: Success. You can now start the database server using:950gitlab # [ 11.498663] postgresql-pre-start[779]: pg_ctl -D /var/lib/postgresql/18 -l logfile start951gitlab # [ 11.526212] dhcpcd[750]: eth0: soliciting a DHCP lease952gitlab # [ 11.537046] dhcpcd[750]: eth0: offered 10.0.2.15 from 10.0.2.2953gitlab # [ 11.560731] dhcpcd[750]: eth0: probing address 10.0.2.15/24954gitlab # [ 11.667007] postgres[851]: [851] LOG: starting PostgreSQL 18.4 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit955gitlab # [ 11.672927] postgres[851]: [851] LOG: listening on IPv6 address "::1", port 5432956gitlab # [ 11.676345] postgres[851]: [851] LOG: listening on IPv4 address "127.0.0.1", port 5432957gitlab # [ 11.679864] postgres[851]: [851] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"958gitlab # [ 11.690852] postgres[860]: [860] LOG: database system was shut down at 2026-08-16 17:01:01 GMT959gitlab # [ 11.699189] postgres[851]: [851] LOG: database system is ready to accept connections960gitlab # [ 11.704816] systemd[1]: Started PostgreSQL Server.961gitlab # [ 11.710858] systemd[1]: Starting PostgreSQL Setup Scripts...962gitlab # [ 12.166938] postgresql-setup-start[871]: CREATE DATABASE963gitlab # [ 12.223007] postgresql-setup-start[890]: CREATE ROLE964gitlab # [ 12.246077] postgresql-setup-start[892]: ALTER DATABASE965gitlab # [ 12.294453] postgresql-setup-start[897]: CREATE ROLE966gitlab # [ 12.298830] systemd[1]: Finished PostgreSQL Setup Scripts.967gitlab # [ 12.301757] systemd[1]: Reached target PostgreSQL.968gitlab # [ 12.305813] systemd[1]: Starting gitlab-postgresql.service...969gitlab # [ 12.393980] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[880]: mkdir -p /var/gitlab/state/home/.ssh: OK970gitlab # [ 12.398455] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[880]: chmod 700 /var/gitlab/state/home/.ssh: OK971gitlab # [ 12.478286] gitlab-postgresql-start[905]: CREATE DATABASE972gitlab # [ 12.517060] systemd[1]: Finished gitlab-config.service.973gitlab # [ 12.528208] systemd[1]: Started gitaly.service.974gitlab # [ 12.534970] systemd[1]: Starting gitlab-db-config.service...975gitlab # [ 12.558062] gitlab-postgresql-start[920]: CREATE EXTENSION976gitlab # [ 12.698140] gitlab-postgresql-start[925]: CREATE EXTENSION977gitlab # [ 12.702965] systemd[1]: Finished gitlab-postgresql.service.978gitlab # [ 13.345992] gitaly[923]: time="2026-08-16T17:01:04.011Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/0r0qd84zrxhqq373hk9spv8j9pg0qlnq-gitaly.toml' and fix the errors that are printed." pid=923979gitlab # [ 13.351428] gitaly[923]: time="2026-08-16T17:01:04.012Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=923980gitlab # [ 13.353176] gitaly[923]: time="2026-08-16T17:01:04.012Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=923981gitlab # [ 13.355211] gitaly[923]: time="2026-08-16T17:01:04.012Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=923982gitlab # [ 13.357074] gitaly[923]: time="2026-08-16T17:01:04.012Z" level=info msg="Starting Gitaly" pid=923 version=983gitlab # [ 13.590724] gitaly[923]: time="2026-08-16T17:01:04.256Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=242 pid=923984gitlab # [ 13.592852] gitaly[923]: time="2026-08-16T17:01:04.256Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=923985gitlab # [ 13.595175] gitaly[923]: time="2026-08-16T17:01:04.257Z" level=info msg="finished initializing command factory" duration_ms=0 pid=923986gitlab # [ 13.597518] gitaly[923]: time="2026-08-16T17:01:04.257Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-923/git-exec-3034779991.d/git pid=923987gitlab # [ 13.599810] gitaly[923]: time="2026-08-16T17:01:04.263Z" level=info msg="finished detecting git version" duration_ms=5 pid=923988gitlab # [ 13.601961] gitaly[923]: time="2026-08-16T17:01:04.263Z" level=info msg="using Git version" pid=923 version=2.53.g989gitlab # [ 13.603678] gitaly[923]: time="2026-08-16T17:01:04.264Z" level=info msg="clearing disk cache object folder" pid=923 storage=default990gitlab # [ 13.605879] gitaly[923]: time="2026-08-16T17:01:04.264Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache398169986 pid=923 storage=default991gitlab # [ 13.608902] gitaly[923]: time="2026-08-16T17:01:04.264Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache398169986 pid=923 storage=default992gitlab # [ 13.612224] gitaly[923]: time="2026-08-16T17:01:04.264Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=923993gitlab # [ 13.615321] gitaly[923]: time="2026-08-16T17:01:04.265Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=923994gitlab # [ 13.618719] gitaly[923]: time="2026-08-16T17:01:04.265Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache398169986 clear_duration_ms=0 pid=923 storage=default995gitlab # [ 13.631187] gitaly[923]: time="2026-08-16T17:01:04.297Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=923996gitlab # [ 13.633902] gitaly[923]: time="2026-08-16T17:01:04.297Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=923 schema=unix997gitlab # [ 13.636277] gitaly[923]: time="2026-08-16T17:01:04.297Z" level=info msg="counting repositories" pid=923998gitlab # [ 13.638892] gitaly[923]: time="2026-08-16T17:01:04.297Z" level=info msg="starting to count repositories" pid=923 storage_path=/var/gitlab/state/repositories999gitlab # [ 13.641165] gitaly[923]: time="2026-08-16T17:01:04.297Z" level=info msg="finished tempdir cleaner walk" pid=923 storage=default time_ms=01000gitlab # [ 13.643148] gitaly[923]: time="2026-08-16T17:01:04.297Z" level=info msg="listening at address" address=/run/gitaly/gitaly-923/sock.d/intern pid=923 schema=unix1001gitlab # [ 13.645606] gitaly[923]: time="2026-08-16T17:01:04.297Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=923 storage_path=/var/gitlab/state/repositories1002gitlab # [ 13.648064] gitaly[923]: time="2026-08-16T17:01:04.297Z" level=info msg="completed counting all repositories" counting_duration=0 pid=9231003gitlab # [ 13.650078] gitaly[923]: time="2026-08-16T17:01:04.300Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=9231004gitlab # [ 13.652137] gitaly[923]: time="2026-08-16T17:01:04.300Z" level=info msg="Started Gitaly" duration_ms=287 pid=9231005gitlab # [ 13.653756] gitaly[923]: time="2026-08-16T17:01:04.300Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=9231006gitlab # [ 13.655813] gitaly[923]: time="2026-08-16T17:01:04.300Z" level=info msg="maintenance: daily scheduled" pid=923 scheduled="2026-08-17 12:00:00 +0000 UTC"1007gitlab # [ 14.058991] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[928]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1008gitlab # [ 14.068796] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[928]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1009gitlab # [ 14.078632] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[928]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1010gitlab # [ 16.970574] dhcpcd[750]: eth0: leased 10.0.2.15 for 86400 seconds1011gitlab # [ 16.973598] dhcpcd[750]: eth0: adding route to 10.0.2.0/241012gitlab # [ 16.975996] dhcpcd[750]: eth0: adding default route via 10.0.2.21013gitlab # [ 17.152957] systemd[1]: Started DHCP Client.1014gitlab # [ 17.157302] systemd[1]: Reached target Network is Online.1015gitlab # [ 17.880590] gitaly[923]: time="2026-08-16T17:01:08.545Z" level=info msg="License database preloaded" duration_ms=4532 pid=9231016gitlab # [ 67.614728] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[928]: W, [2026-08-16T17:01:58.280096 #928] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1017gitlab # [ 70.570853] gitlab-workhorse[825]: time="2026-08-16T17:02:01Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1018gitlab # [ 71.006688] postgres[1507]: [1507] ERROR: relation "feature_gates" does not exist at character 5231019gitlab # [ 71.011295] postgres[1507]: [1507] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1020gitlab # [ 71.015489] postgres[1507]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1021gitlab # [ 71.020134] postgres[1507]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1022gitlab # [ 71.023853] postgres[1507]: attidentity AS identity,1023gitlab # [ 71.026447] postgres[1507]: attgenerated as attgenerated1024gitlab # [ 71.029118] postgres[1507]: FROM pg_attribute a1025gitlab # [ 71.031243] postgres[1507]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1026gitlab # [ 71.035219] postgres[1507]: LEFT JOIN pg_type t ON a.atttypid = t.oid1027gitlab # [ 71.038209] postgres[1507]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1028gitlab # [ 71.042673] postgres[1507]: WHERE a.attrelid = '"feature_gates"'::regclass1029gitlab # [ 71.045694] postgres[1507]: AND a.attnum > 0 AND NOT a.attisdropped1030gitlab # [ 71.048476] postgres[1507]: ORDER BY a.attnum1031gitlab # [ 71.050478] postgres[1507]:1032gitlab # [ 77.500523] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1568]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1033gitlab # [ 77.501162] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1568]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1034gitlab # [ 80.585609] gitlab-workhorse[825]: time="2026-08-16T17:02:11Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1035gitlab # [ 90.586861] gitlab-workhorse[825]: time="2026-08-16T17:02:21Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1036gitlab # [ 100.597784] gitlab-workhorse[825]: time="2026-08-16T17:02:31Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1037gitlab # [ 107.487519] postgres[1698]: [1698] ERROR: relation "table_without_models" does not exist1038gitlab # [ 107.487962] postgres[1698]: [1698] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1039gitlab # [ 110.598804] gitlab-workhorse[825]: time="2026-08-16T17:02:41Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1040gitlab # [ 120.606675] gitlab-workhorse[825]: time="2026-08-16T17:02:51Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1041gitlab # [ 130.610671] gitlab-workhorse[825]: time="2026-08-16T17:03:01Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1042gitlab # [ 139.077501] systemd[1]: Finished gitlab-db-config.service.1043gitlab # [ 139.083783] systemd[1]: Started gitlab-sidekiq.service.1044gitlab # [ 139.089258] systemd[1]: Starting gitlab.service...1045gitlab # [ 139.702796] bundle[2091]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1046gitlab # [ 139.703362] bundle[2091]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1047gitlab # [ 139.704703] bundle[2091]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1048gitlab # [ 140.613146] gitlab-workhorse[825]: time="2026-08-16T17:03:11Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1049gitlab # [ 144.937581] sidekiq-cluster[2090]: {"severity":"INFO","time":"2026-08-16T17:03:15.564Z","message":"Starting cluster with 1 processes"}1050gitlab # [ 145.134156] bundle[2091]: {"timestamp":"2026-08-16T17:03:15.771Z","pid":2091,"message":"* Enabling systemd notification integration"}1051gitlab # [ 145.139689] bundle[2091]: {"timestamp":"2026-08-16T17:03:15.799Z","pid":2091,"message":"Puma starting in cluster mode..."}1052gitlab # [ 145.144262] bundle[2091]: {"timestamp":"2026-08-16T17:03:15.799Z","pid":2091,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1053gitlab # [ 145.148848] bundle[2091]: {"timestamp":"2026-08-16T17:03:15.799Z","pid":2091,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1054gitlab # [ 145.154588] bundle[2091]: {"timestamp":"2026-08-16T17:03:15.799Z","pid":2091,"message":"* Min threads: 0"}1055gitlab # [ 145.158487] bundle[2091]: {"timestamp":"2026-08-16T17:03:15.799Z","pid":2091,"message":"* Max threads: 4"}1056gitlab # [ 145.162923] bundle[2091]: {"timestamp":"2026-08-16T17:03:15.799Z","pid":2091,"message":"* Environment: production"}1057gitlab # [ 145.167407] bundle[2091]: {"timestamp":"2026-08-16T17:03:15.799Z","pid":2091,"message":"* Master PID: 2091"}1058gitlab # [ 145.171778] bundle[2091]: {"timestamp":"2026-08-16T17:03:15.799Z","pid":2091,"message":"* Workers: 2"}1059gitlab # [ 145.175878] bundle[2091]: {"timestamp":"2026-08-16T17:03:15.799Z","pid":2091,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1060gitlab # [ 145.180987] bundle[2091]: {"timestamp":"2026-08-16T17:03:15.799Z","pid":2091,"message":"* Preloading application"}1061gitlab # [ 150.622371] gitlab-workhorse[825]: time="2026-08-16T17:03:21Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1062gitlab # [ 160.630841] gitlab-workhorse[825]: time="2026-08-16T17:03:31Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1063gitlab # [ 170.638613] gitlab-workhorse[825]: time="2026-08-16T17:03:41Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1064gitlab # [ 180.648303] gitlab-workhorse[825]: time="2026-08-16T17:03:51Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1065gitlab # [ 184.162396] bundle[2091]: W, [2026-08-16T17:03:54.827237 #2091] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1066gitlab # [ 188.721714] sidekiq-cluster[2139]: 2026-08-16T17:03:59.386Z pid=2139 tid=xrn INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2139, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>433049600}1067gitlab # [ 188.999280] sidekiq-cluster[2139]: W, [2026-08-16T17:03:59.665034 #2139] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1068gitlab # [ 189.066318] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:03:59.732Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1069gitlab # [ 190.658699] gitlab-workhorse[825]: time="2026-08-16T17:04:01Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1070gitlab # [ 193.006273] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.671Z","message":"GitLab reliable fetch activated!"}1071gitlab # [ 193.006724] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.671Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1072gitlab # [ 193.040396] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.706Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1073gitlab # [ 193.047380] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.709Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1074gitlab # [ 193.054509] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.712Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1075gitlab # [ 193.061086] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.714Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1076gitlab # [ 193.068409] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.717Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1077gitlab # [ 193.075280] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.720Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1078gitlab # [ 193.084775] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.722Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1079gitlab # [ 193.086805] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.724Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1080gitlab # [ 193.088866] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.726Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1081gitlab # [ 193.090874] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.728Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1082gitlab # [ 193.093295] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.730Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1083gitlab # [ 193.095421] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.732Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1084gitlab # [ 193.097550] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.734Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1085gitlab # [ 193.099666] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.736Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1086gitlab # [ 193.101899] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.739Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1087gitlab # [ 193.103982] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.746Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1088gitlab # [ 193.106117] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.750Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1089gitlab # [ 193.108069] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.759Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1090gitlab # [ 193.110190] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.768Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1091gitlab # [ 193.112243] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.774Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1092gitlab # [ 193.115966] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.781Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1093gitlab # [ 193.121807] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.787Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1094gitlab # [ 193.126587] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.792Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1095gitlab # [ 193.131101] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.797Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1096gitlab # [ 193.137390] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.801Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1097gitlab # [ 193.140374] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.806Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1098gitlab # [ 193.144262] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.810Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1099gitlab # [ 193.148259] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.813Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1100gitlab # [ 193.151280] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.817Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1101gitlab # [ 193.154706] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.820Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1102gitlab # [ 193.157780] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.823Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1103gitlab # [ 193.161078] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.827Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1104gitlab # [ 193.163999] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.830Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1105gitlab # [ 193.167002] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.833Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1106gitlab # [ 193.169714] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.835Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1107gitlab # [ 193.171779] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.837Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1108gitlab # [ 193.174137] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.840Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1109gitlab # [ 193.176947] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.843Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1110gitlab # [ 193.178903] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.844Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1111gitlab # [ 193.180931] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.846Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1112gitlab # [ 193.182999] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.848Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1113gitlab # [ 193.185167] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.850Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1114gitlab # [ 193.187273] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.852Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1115gitlab # [ 193.189411] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.854Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1116gitlab # [ 193.191528] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.857Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1117gitlab # [ 193.193892] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.859Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1118gitlab # [ 193.195975] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.860Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1119gitlab # [ 193.198217] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.863Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1120gitlab # [ 193.200256] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.865Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1121gitlab # [ 193.202307] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.867Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1122gitlab # [ 193.204408] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.869Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1123gitlab # [ 193.206423] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.871Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1124gitlab # [ 193.216283] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.882Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1125gitlab # [ 193.218742] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.884Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1126gitlab # [ 193.221028] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.887Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1127gitlab # [ 193.223211] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.889Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1128gitlab # [ 193.225469] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.891Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1129gitlab # [ 193.227692] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.893Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1130gitlab # [ 193.230008] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.895Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1131gitlab # [ 193.232194] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.896Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1132gitlab # [ 193.234160] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.898Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1133gitlab # [ 193.236137] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.900Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1134gitlab # [ 193.238209] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.903Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1135gitlab # [ 193.240370] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.905Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1136gitlab # [ 193.242522] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.907Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1137gitlab # [ 193.244697] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.910Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1138gitlab # [ 193.246660] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.911Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1139gitlab # [ 193.248783] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.913Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1140gitlab # [ 193.250940] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.915Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1141gitlab # [ 193.253192] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.916Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1142gitlab # [ 193.255358] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.918Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1143gitlab # [ 193.257665] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.919Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1144gitlab # [ 193.259808] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.921Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1145gitlab # [ 193.262306] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.923Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1146gitlab # [ 193.264609] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.924Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1147gitlab # [ 193.266844] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.926Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1148gitlab # [ 193.269075] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.928Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1149gitlab # [ 193.271450] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.929Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1150gitlab # [ 193.273699] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.931Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1151gitlab # [ 193.275765] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.933Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1152gitlab # [ 193.278241] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.934Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1153gitlab # [ 193.280635] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.936Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1154gitlab # [ 193.282852] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.938Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1155gitlab # [ 193.285070] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.940Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1156gitlab # [ 193.287262] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.942Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1157gitlab # [ 193.289479] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.944Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1158gitlab # [ 193.291673] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.946Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1159gitlab # [ 193.293980] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.948Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1160gitlab # [ 193.296236] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.949Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1161gitlab # [ 193.298421] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.951Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1162gitlab # [ 193.300693] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.953Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1163gitlab # [ 193.302846] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.954Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1164gitlab # [ 193.305151] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.956Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1165gitlab # [ 193.307502] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.958Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1166gitlab # [ 193.309588] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.960Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1167gitlab # [ 193.311862] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.963Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1168gitlab # [ 193.314240] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.964Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1169gitlab # [ 193.316466] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.966Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1170gitlab # [ 193.318626] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.977Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1171gitlab # [ 193.320888] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.979Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1172gitlab # [ 193.322996] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.981Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1173gitlab # [ 193.325295] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.984Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1174gitlab # [ 193.327225] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.986Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1175gitlab # [ 193.329412] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.989Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1176gitlab # [ 193.331629] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.991Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1177gitlab # [ 193.334010] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.993Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1178gitlab # [ 193.370825] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:04.035Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1179gitlab # [ 193.374071] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:04.040Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1180gitlab # [ 193.376597] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:04.041Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1181gitlab # [ 200.666300] gitlab-workhorse[825]: time="2026-08-16T17:04:11Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1182gitlab # [ 210.672711] gitlab-workhorse[825]: time="2026-08-16T17:04:21Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1183gitlab # [ 220.674360] gitlab-workhorse[825]: time="2026-08-16T17:04:31Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1184gitlab # [ 230.682251] gitlab-workhorse[825]: time="2026-08-16T17:04:41Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1185gitlab # [ 233.368271] postgres[2885]: [2885] ERROR: relation "table_without_models" does not exist1186gitlab # [ 233.371779] postgres[2885]: [2885] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1187gitlab # [ 234.499820] postgres[2896]: [2896] ERROR: relation "table_without_models" does not exist1188gitlab # [ 234.503569] postgres[2896]: [2896] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1189gitlab # [ 238.325562] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:48.990Z","message":"Booted Rails 7.2.3.1 application in production environment"}1190gitlab # [ 238.332997] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:48.998Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1191gitlab # [ 238.339267] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:48.999Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1192gitlab # [ 238.344826] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:48.999Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1193gitlab # [ 238.350850] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:49.000Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1194gitlab # [ 240.220374] bundle[2091]: {"timestamp":"2026-08-16T17:04:50.885Z","pid":2091,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1195gitlab # [ 240.220709] bundle[2091]: {"timestamp":"2026-08-16T17:04:50.885Z","pid":2091,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1196gitlab # [ 240.220900] bundle[2091]: {"timestamp":"2026-08-16T17:04:50.885Z","pid":2091,"message":"! #\u003cThread:0x0000ebb3dee85520 /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1197gitlab # [ 240.221068] bundle[2091]: {"timestamp":"2026-08-16T17:04:50.885Z","pid":2091,"message":"! #\u003cThread:0x0000ebb3dcd915d0 /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1198gitlab # [ 240.221174] bundle[2091]: {"timestamp":"2026-08-16T17:04:50.885Z","pid":2091,"message":"Use Ctrl-C to stop"}1199gitlab # [ 240.221289] bundle[2091]: {"timestamp":"2026-08-16T17:04:50.886Z","pid":2091,"message":"Sending status to systemd every 1.0 sec"}1200gitlab # [ 241.027294] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:51.692Z","message":"Cleaning working queues"}1201gitlab # [ 241.036595] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:51.701Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"4620f6c4d510d15de69ef7e7","created_at":"2026-08-16T17:03:09.156Z","trace_propagation_headers":{"sentry-trace":"77ea771926b942ffab8f1c6427643b5a-eb4edbcab63b43ca","baggage":"sentry-trace_id=77ea771926b942ffab8f1c6427643b5a,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"ed71247dba7f4083f3b7f4537d14d99d","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-16T17:03:09.168Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-4620f6c4d510d15de69ef7e7: start","job_status":"start","queue_duration_s":102.532972,"scheduling_latency_s":102.533079}1202gitlab # [ 241.073142] bundle[2091]: {"timestamp":"2026-08-16T17:04:51.709Z","pid":2091,"message":"- Worker 0 (PID: 2998) booted in 0.72s, phase: 0"}1203gitlab # [ 241.075584] bundle[2091]: {"timestamp":"2026-08-16T17:04:51.727Z","pid":2091,"message":"- Worker 1 (PID: 3002) booted in 0.7s, phase: 0"}1204gitlab # [ 241.077603] systemd[1]: Started gitlab.service.1205gitlab # [ 241.078350] systemd[1]: Reached target Common target for all GitLab services..1206gitlab # [ 241.079339] systemd[1]: Starting setup-gitlab.service...1207gitlab # [ 241.104487] setup-gitlab-start[3033]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1208gitlab # [ 241.252125] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:51.914Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"4620f6c4d510d15de69ef7e7","created_at":"2026-08-16T17:03:09.156Z","trace_propagation_headers":{"sentry-trace":"77ea771926b942ffab8f1c6427643b5a-eb4edbcab63b43ca","baggage":"sentry-trace_id=77ea771926b942ffab8f1c6427643b5a,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"ed71247dba7f4083f3b7f4537d14d99d","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-16T17:03:09.168Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-4620f6c4d510d15de69ef7e7: done: 0.213638 sec","job_status":"done","queue_duration_s":102.532972,"scheduling_latency_s":102.533079,"redis_calls":24,"redis_duration_s":0.0058449999999999995,"redis_read_bytes":912,"redis_write_bytes":2622,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.002263,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002674,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000908,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":9,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.097619,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.10743552,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.213638,"completed_at":"2026-08-16T17:04:51.914Z","load_balancing_strategy":"primary","db_duration_s":0.052816,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1209gitlab # [ 244.548053] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:04:55 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 34181210gitlab # [ 244.552064] setup-gitlab-start[3033]: + TOKEN=nixbot-test-token-of-20-chars1211gitlab # [ 244.553890] setup-gitlab-start[3033]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1212gitlab # [ 244.570135] runuser[3063]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1213gitlab # [ 245.135739] setup-gitlab-start[3064]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1214gitlab # [ 245.142443] setup-gitlab-start[3064]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1215gitlab # [ 245.148765] setup-gitlab-start[3064]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1216gitlab # [ 245.963472] setup-gitlab-start[3064]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1217gitlab # [ 245.963801] setup-gitlab-start[3064]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1218gitlab # [ 245.966162] setup-gitlab-start[3064]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1219gitlab # [ 254.977947] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:05.639Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"92690fc57d4d4f2d7d45c497","created_at":"2026-08-16T17:05:05.480Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"404b1a1ae2bf286263042449e2b3204d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.632Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-92690fc57d4d4f2d7d45c497: start","job_status":"start","queue_duration_s":0.006877,"scheduling_latency_s":0.006947}1220gitlab # [ 255.419434] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:06.084Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1221gitlab # [ 255.567507] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:06.231Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"92690fc57d4d4f2d7d45c497","created_at":"2026-08-16T17:05:05.480Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"404b1a1ae2bf286263042449e2b3204d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.632Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-92690fc57d4d4f2d7d45c497: done: 0.591977 sec","job_status":"done","queue_duration_s":0.006877,"scheduling_latency_s":0.006947,"redis_calls":10,"redis_duration_s":0.027338,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.009652,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.012906,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00478,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.08498,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00389034,"duration_s":0.591977,"completed_at":"2026-08-16T17:05:06.231Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.134916,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1222gitlab # [ 255.670991] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:06.304Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"6ac9d78385a25834609ddf7d","created_at":"2026-08-16T17:05:05.692Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"90cb41712a4f85104bfcaee1026e5358","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-16T17:05:05.724Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-6ac9d78385a25834609ddf7d: start","job_status":"start","queue_duration_s":0.579755,"scheduling_latency_s":0.580055}1223gitlab # [ 255.998571] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:06.660Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"6ac9d78385a25834609ddf7d","created_at":"2026-08-16T17:05:05.692Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"90cb41712a4f85104bfcaee1026e5358","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-16T17:05:05.724Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-6ac9d78385a25834609ddf7d: done: 0.35596 sec","job_status":"done","queue_duration_s":0.579755,"scheduling_latency_s":0.580055,"redis_calls":10,"redis_duration_s":0.021741,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002766,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.015083,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003892,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.058,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.058,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.120953,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00782404,"duration_s":0.35596,"completed_at":"2026-08-16T17:05:06.659Z","load_balancing_strategy":"primary","db_duration_s":0.082122,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1224gitlab # [ 256.089023] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:06.674Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"32b2e8c601a028472484f98b","created_at":"2026-08-16T17:05:05.801Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e5e7dd4cbeac8f43d493bbeff30a93de","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.833Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-32b2e8c601a028472484f98b: start","job_status":"start","queue_duration_s":0.840953,"scheduling_latency_s":0.841023}1225gitlab # [ 256.434738] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:07.098Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"32b2e8c601a028472484f98b","created_at":"2026-08-16T17:05:05.801Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e5e7dd4cbeac8f43d493bbeff30a93de","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.833Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-32b2e8c601a028472484f98b: done: 0.423503 sec","job_status":"done","queue_duration_s":0.840953,"scheduling_latency_s":0.841023,"redis_calls":10,"redis_duration_s":0.026865,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004482,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.016929,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005454,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.034,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.034,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.097664,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00767968,"duration_s":0.423503,"completed_at":"2026-08-16T17:05:07.097Z","load_balancing_strategy":"primary","db_duration_s":0.115095,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1226gitlab # [ 256.537442] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:07.115Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"c162b9d2feb32b709c1f9ab3","created_at":"2026-08-16T17:05:05.917Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fe63b18b606c1afd223b323eb72959de","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.935Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-c162b9d2feb32b709c1f9ab3: start","job_status":"start","queue_duration_s":1.180234,"scheduling_latency_s":1.180473}1227gitlab # [ 256.824900] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:07.489Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"c162b9d2feb32b709c1f9ab3","created_at":"2026-08-16T17:05:05.917Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fe63b18b606c1afd223b323eb72959de","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.935Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-c162b9d2feb32b709c1f9ab3: done: 0.373763 sec","job_status":"done","queue_duration_s":1.180234,"scheduling_latency_s":1.180473,"redis_calls":12,"redis_duration_s":0.07175999999999999,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.017308,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.035722,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.01873,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.110795,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.01378264,"exclusive_lock_hold_duration_s":0.06284796000000001,"duration_s":0.373763,"completed_at":"2026-08-16T17:05:07.489Z","load_balancing_strategy":"primary","db_duration_s":0.047014,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1228gitlab # [ 256.918757] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:07.497Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"1a11e4d67b9db15ae2c5339b","created_at":"2026-08-16T17:05:06.037Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"20c6e8a7e9911f0e294db8127773b6b1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.094Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-1a11e4d67b9db15ae2c5339b: start","job_status":"start","queue_duration_s":1.402823,"scheduling_latency_s":1.402881}1229gitlab # [ 257.009612] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:07.670Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"1a11e4d67b9db15ae2c5339b","created_at":"2026-08-16T17:05:06.037Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"20c6e8a7e9911f0e294db8127773b6b1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.094Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-1a11e4d67b9db15ae2c5339b: done: 0.173504 sec","job_status":"done","queue_duration_s":1.402823,"scheduling_latency_s":1.402881,"redis_calls":12,"redis_duration_s":0.016338,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00136,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005041,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.009937,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.041,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.041,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030999,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00175398,"duration_s":0.173504,"completed_at":"2026-08-16T17:05:07.670Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.041243,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1230gitlab # [ 257.082930] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:07.684Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"eb1aa2a58672c957545207e4","created_at":"2026-08-16T17:05:06.206Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"961689ec4788bb342ab118f49c9a8b57","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.235Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-eb1aa2a58672c957545207e4: start","job_status":"start","queue_duration_s":1.448441,"scheduling_latency_s":1.448504}1231gitlab # [ 257.187195] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:07.852Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1232gitlab # [ 257.264556] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:07.929Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"eb1aa2a58672c957545207e4","created_at":"2026-08-16T17:05:06.206Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"961689ec4788bb342ab118f49c9a8b57","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.235Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-eb1aa2a58672c957545207e4: done: 0.2443 sec","job_status":"done","queue_duration_s":1.448441,"scheduling_latency_s":1.448504,"redis_calls":10,"redis_duration_s":0.060951000000000005,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.007505,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.01785,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.035596,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.06812,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00268306,"duration_s":0.2443,"completed_at":"2026-08-16T17:05:07.928Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00666,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1233gitlab # [ 257.364988] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:07.945Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"0525dfa91925aecd579abab1","created_at":"2026-08-16T17:05:06.373Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"238cae289a5fa1afe3648a8ce244e0c8","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.430Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-0525dfa91925aecd579abab1: start","job_status":"start","queue_duration_s":1.515239,"scheduling_latency_s":1.5153}1234gitlab # [ 257.434607] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:08.098Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"0525dfa91925aecd579abab1","created_at":"2026-08-16T17:05:06.373Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"238cae289a5fa1afe3648a8ce244e0c8","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.430Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-0525dfa91925aecd579abab1: done: 0.15297 sec","job_status":"done","queue_duration_s":1.515239,"scheduling_latency_s":1.5153,"redis_calls":10,"redis_duration_s":0.0069619999999999994,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001289,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004227,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001446,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.077546,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0010227,"duration_s":0.15297,"completed_at":"2026-08-16T17:05:08.098Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012832,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1235gitlab # [ 257.522538] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:08.103Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"94a29c2708688e5aee4d32e4","created_at":"2026-08-16T17:05:06.468Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2fd75dc18420dbae3e88091aec0088c2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.527Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-94a29c2708688e5aee4d32e4: start","job_status":"start","queue_duration_s":1.576248,"scheduling_latency_s":1.576284}1236gitlab # [ 257.895510] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:08.557Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"94a29c2708688e5aee4d32e4","created_at":"2026-08-16T17:05:06.468Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2fd75dc18420dbae3e88091aec0088c2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.527Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-94a29c2708688e5aee4d32e4: done: 0.453957 sec","job_status":"done","queue_duration_s":1.576248,"scheduling_latency_s":1.576284,"redis_calls":14,"redis_duration_s":0.007821999999999999,"redis_read_bytes":13,"redis_write_bytes":1641,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002395,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":576,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00325,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002177,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.087,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.084,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.326423,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00159434,"exclusive_lock_hold_duration_s":0.38178378,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.453957,"completed_at":"2026-08-16T17:05:08.557Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.117162,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1237gitlab # [ 257.998286] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:08.561Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"eb860c0688df5581eeee2300","created_at":"2026-08-16T17:05:06.573Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"41b1a9335f3471df1502395afadb9f25","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.610Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-eb860c0688df5581eeee2300: start","job_status":"start","queue_duration_s":1.95076,"scheduling_latency_s":1.950812}1238gitlab # [ 258.017637] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:08.625Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"eb860c0688df5581eeee2300","created_at":"2026-08-16T17:05:06.573Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"41b1a9335f3471df1502395afadb9f25","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.610Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-eb860c0688df5581eeee2300: done: 0.064199 sec","job_status":"done","queue_duration_s":1.95076,"scheduling_latency_s":1.950812,"redis_calls":17,"redis_duration_s":0.005784,"redis_read_bytes":15,"redis_write_bytes":2007,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002981,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1150,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001714,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.00048,"redis_rate_limiting_write_bytes":51,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000609,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043735,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00054114,"extra.cells_stale_requests_cleanup_cron_worker.removed_count":0,"duration_s":0.064199,"completed_at":"2026-08-16T17:05:08.625Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002784,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1239gitlab # [ 258.063930] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:08.628Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"affad6467eb2da9fc121d05a","created_at":"2026-08-16T17:05:06.654Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8d4d994588265d538fd01ea617d35480","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.698Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-affad6467eb2da9fc121d05a: start","job_status":"start","queue_duration_s":1.930365,"scheduling_latency_s":1.9304}1240gitlab # [ 258.077443] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:08.689Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"affad6467eb2da9fc121d05a","created_at":"2026-08-16T17:05:06.654Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8d4d994588265d538fd01ea617d35480","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.698Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-affad6467eb2da9fc121d05a: done: 0.061369 sec","job_status":"done","queue_duration_s":1.930365,"scheduling_latency_s":1.9304,"redis_calls":19,"redis_duration_s":0.004680999999999999,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001005,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000406,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002508,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000762,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043918,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036804,"duration_s":0.061369,"completed_at":"2026-08-16T17:05:08.689Z","load_balancing_strategy":"primary","db_duration_s":0.004171,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1241gitlab # [ 258.120324] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:08.692Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"4ae241c01e5b1a36d5542c49","created_at":"2026-08-16T17:05:06.756Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"003ad569740196713259b624c7feb9f1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.797Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-4ae241c01e5b1a36d5542c49: start","job_status":"start","queue_duration_s":1.89434,"scheduling_latency_s":1.894368}1242gitlab # [ 258.134494] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:08.707Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1243gitlab # [ 258.137946] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:08.716Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"4ae241c01e5b1a36d5542c49","created_at":"2026-08-16T17:05:06.756Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"003ad569740196713259b624c7feb9f1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.797Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-4ae241c01e5b1a36d5542c49: done: 0.024221 sec","job_status":"done","queue_duration_s":1.89434,"scheduling_latency_s":1.894368,"redis_calls":10,"redis_duration_s":0.001756,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000387,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001019,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00035,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014387,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032712,"duration_s":0.024221,"completed_at":"2026-08-16T17:05:08.716Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000603,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1244gitlab # [ 258.181199] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:08.717Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"ceca84eaeb740c94fd5ff8c7","created_at":"2026-08-16T17:05:06.873Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d1a27086d13c2267fa17b42098bec5ea","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.936Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-ceca84eaeb740c94fd5ff8c7: start","job_status":"start","queue_duration_s":1.781528,"scheduling_latency_s":1.78155}1245gitlab # [ 258.195763] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:08.757Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"ceca84eaeb740c94fd5ff8c7","created_at":"2026-08-16T17:05:06.873Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d1a27086d13c2267fa17b42098bec5ea","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.936Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-ceca84eaeb740c94fd5ff8c7: done: 0.039397 sec","job_status":"done","queue_duration_s":1.781528,"scheduling_latency_s":1.78155,"redis_calls":13,"redis_duration_s":0.002228,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00035,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001129,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000749,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02564,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.012565999999999999,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.039397,"completed_at":"2026-08-16T17:05:08.757Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004926,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1246gitlab # [ 258.240112] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:08.758Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"0482c20fc1d3256f9b35ee11","created_at":"2026-08-16T17:05:07.088Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:07.128Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-0482c20fc1d3256f9b35ee11: start","job_status":"start","queue_duration_s":1.629671,"scheduling_latency_s":1.629692}1247gitlab # [ 258.253437] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:08.873Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"0482c20fc1d3256f9b35ee11","created_at":"2026-08-16T17:05:07.088Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:07.128Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-0482c20fc1d3256f9b35ee11: done: 0.114806 sec","job_status":"done","queue_duration_s":1.629671,"scheduling_latency_s":1.629692,"redis_calls":71,"redis_duration_s":0.010968,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.00141,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000787,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.008337,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000434,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.101244,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025186,"duration_s":0.114806,"completed_at":"2026-08-16T17:05:08.873Z","load_balancing_strategy":"primary","db_duration_s":0.002697,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1248gitlab # [ 258.296085] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:08.874Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"3929a7cb87f524225764303d","created_at":"2026-08-16T17:05:07.146Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"40bf662c4370e8865d7c642f3f357bd9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:07.174Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-3929a7cb87f524225764303d: start","job_status":"start","queue_duration_s":1.700421,"scheduling_latency_s":1.700439}1249gitlab # [ 258.310367] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:08.886Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1250gitlab # [ 258.314176] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:08.903Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"3929a7cb87f524225764303d","created_at":"2026-08-16T17:05:07.146Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"40bf662c4370e8865d7c642f3f357bd9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:07.174Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-3929a7cb87f524225764303d: done: 0.028432 sec","job_status":"done","queue_duration_s":1.700421,"scheduling_latency_s":1.700439,"redis_calls":10,"redis_duration_s":0.002082,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000278,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001298,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000506,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015572,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00061946,"duration_s":0.028432,"completed_at":"2026-08-16T17:05:08.902Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000625,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1251gitlab # [ 258.357318] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:08.907Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"47da907f5749f2fd5f9bad86","created_at":"2026-08-16T17:05:07.249Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"14216ee33a86f5f77a05f0f09d5ff903","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:07.318Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-47da907f5749f2fd5f9bad86: start","job_status":"start","queue_duration_s":1.588715,"scheduling_latency_s":1.588762}1252gitlab # [ 258.371371] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:08.976Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"47da907f5749f2fd5f9bad86","created_at":"2026-08-16T17:05:07.249Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"14216ee33a86f5f77a05f0f09d5ff903","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:07.318Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-47da907f5749f2fd5f9bad86: done: 0.069196 sec","job_status":"done","queue_duration_s":1.588715,"scheduling_latency_s":1.588762,"redis_calls":10,"redis_duration_s":0.003565,"redis_read_bytes":9,"redis_write_bytes":1109,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000585,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":315,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002221,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000759,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040045,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00089288,"duration_s":0.069196,"completed_at":"2026-08-16T17:05:08.976Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013431,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1253gitlab # [ 258.413330] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:08.979Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"2ad225abb24dc8a8eaf885e5","created_at":"2026-08-16T17:05:07.359Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cab2dfc7e41944c4846cb34086dff20d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-16T17:05:07.397Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-2ad225abb24dc8a8eaf885e5: start","job_status":"start","queue_duration_s":1.582334,"scheduling_latency_s":1.582374}1254gitlab # [ 258.426444] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.004Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1255gitlab # [ 258.429818] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.019Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"2ad225abb24dc8a8eaf885e5","created_at":"2026-08-16T17:05:07.359Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cab2dfc7e41944c4846cb34086dff20d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-16T17:05:07.397Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-2ad225abb24dc8a8eaf885e5: done: 0.040269 sec","job_status":"done","queue_duration_s":1.582334,"scheduling_latency_s":1.582374,"redis_calls":10,"redis_duration_s":0.003591,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000928,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002003,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00066,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023142,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00057506,"duration_s":0.040269,"completed_at":"2026-08-16T17:05:09.019Z","load_balancing_strategy":"primary","db_duration_s":0.000821,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1256gitlab # [ 258.470602] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.022Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"a87d9e46f430136edfb799d5","created_at":"2026-08-16T17:05:07.467Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"75f1df41ee36219a2298e0e6bdd2f3a3","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:07.503Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-a87d9e46f430136edfb799d5: start","job_status":"start","queue_duration_s":1.51855,"scheduling_latency_s":1.518582}1257gitlab # [ 258.485076] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.060Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"a87d9e46f430136edfb799d5","created_at":"2026-08-16T17:05:07.467Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"75f1df41ee36219a2298e0e6bdd2f3a3","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:07.503Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-a87d9e46f430136edfb799d5: done: 0.038452 sec","job_status":"done","queue_duration_s":1.51855,"scheduling_latency_s":1.518582,"redis_calls":12,"redis_duration_s":0.004562999999999999,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000566,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002217,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00178,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02138,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00073438,"exclusive_lock_hold_duration_s":0.00532522,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.038452,"completed_at":"2026-08-16T17:05:09.060Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002718,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1258gitlab # [ 258.528120] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.063Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"41017cd7a0486ca39b07b3f3","created_at":"2026-08-16T17:05:07.523Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5f9e0a9015d006c107d612a8e89b52b1","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:07.562Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-41017cd7a0486ca39b07b3f3: start","job_status":"start","queue_duration_s":1.500746,"scheduling_latency_s":1.500772}1259gitlab # [ 258.918520] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.583Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"41017cd7a0486ca39b07b3f3","created_at":"2026-08-16T17:05:07.523Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5f9e0a9015d006c107d612a8e89b52b1","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:07.562Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-41017cd7a0486ca39b07b3f3: done: 0.520899 sec","job_status":"done","queue_duration_s":1.500746,"scheduling_latency_s":1.500772,"redis_calls":565,"redis_duration_s":0.129173,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000541,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001581,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.127051,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.441335,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00039194,"duration_s":0.520899,"completed_at":"2026-08-16T17:05:09.583Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000713,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1260gitlab # [ 259.029590] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.585Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"d307f7e2e07a7811e264a69a","created_at":"2026-08-16T17:05:07.594Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eecf427cd1935af95acceb0164fb6ab1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:07.619Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-d307f7e2e07a7811e264a69a: start","job_status":"start","queue_duration_s":1.966493,"scheduling_latency_s":1.96652}1261gitlab # [ 259.055069] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.609Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"d307f7e2e07a7811e264a69a","created_at":"2026-08-16T17:05:07.594Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eecf427cd1935af95acceb0164fb6ab1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:07.619Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-d307f7e2e07a7811e264a69a: done: 0.023417 sec","job_status":"done","queue_duration_s":1.966493,"scheduling_latency_s":1.96652,"redis_calls":10,"redis_duration_s":0.002474,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000508,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001445,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000521,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013145,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003381,"duration_s":0.023417,"completed_at":"2026-08-16T17:05:09.609Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000849,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1262gitlab # [ 259.111386] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.611Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"397ba1d27924c44a89b02e33","created_at":"2026-08-16T17:05:07.664Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d35cf4ad61681f02d003e166c0bddb2c","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:07.700Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-397ba1d27924c44a89b02e33: start","job_status":"start","queue_duration_s":1.910802,"scheduling_latency_s":1.910822}1263gitlab # [ 259.125994] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.672Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"397ba1d27924c44a89b02e33","created_at":"2026-08-16T17:05:07.664Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d35cf4ad61681f02d003e166c0bddb2c","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:07.700Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-397ba1d27924c44a89b02e33: done: 0.06143 sec","job_status":"done","queue_duration_s":1.910802,"scheduling_latency_s":1.910822,"redis_calls":10,"redis_duration_s":0.003272,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000543,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00221,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000519,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.03,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018616,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00039272,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.06143,"completed_at":"2026-08-16T17:05:09.672Z","load_balancing_strategy":"primary","db_duration_s":0.033092,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1264gitlab # [ 259.168309] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.676Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"8b795ab0c13ef0e7d854c628","created_at":"2026-08-16T17:05:07.711Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"edf35e30af1937a2b93268f2151968d1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:07.733Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-8b795ab0c13ef0e7d854c628: start","job_status":"start","queue_duration_s":1.943233,"scheduling_latency_s":1.943287}1265gitlab # [ 259.182384] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.766Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"8b795ab0c13ef0e7d854c628","created_at":"2026-08-16T17:05:07.711Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"edf35e30af1937a2b93268f2151968d1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:07.733Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-8b795ab0c13ef0e7d854c628: done: 0.090251 sec","job_status":"done","queue_duration_s":1.943233,"scheduling_latency_s":1.943287,"redis_calls":12,"redis_duration_s":0.004778,"redis_read_bytes":11,"redis_write_bytes":1612,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000871,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":347,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002171,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001736,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":7,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.013,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.058261,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00124486,"exclusive_lock_hold_duration_s":0.0394885,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.090251,"completed_at":"2026-08-16T17:05:09.766Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015398,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1266gitlab # [ 259.227980] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.768Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"11154433dcba2be101a42524","created_at":"2026-08-16T17:05:07.801Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"76ab99c45bb1a3a9afc938a8864f542a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-16T17:05:07.857Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-11154433dcba2be101a42524: start","job_status":"start","queue_duration_s":1.911566,"scheduling_latency_s":1.911599}1267gitlab # [ 259.241352] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.788Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1268gitlab # [ 259.244868] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.799Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"11154433dcba2be101a42524","created_at":"2026-08-16T17:05:07.801Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"76ab99c45bb1a3a9afc938a8864f542a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-16T17:05:07.857Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-11154433dcba2be101a42524: done: 0.03068 sec","job_status":"done","queue_duration_s":1.911566,"scheduling_latency_s":1.911599,"redis_calls":10,"redis_duration_s":0.002833,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000589,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001677,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000567,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017929,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004356,"duration_s":0.03068,"completed_at":"2026-08-16T17:05:09.799Z","load_balancing_strategy":"primary","db_duration_s":0.000742,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1269gitlab # [ 259.285824] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.801Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"35e315751fcd0aad500bd85a","created_at":"2026-08-16T17:05:07.906Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6a1dc760537ec1041504f2828bd40ce0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:07.942Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-35e315751fcd0aad500bd85a: start","job_status":"start","queue_duration_s":1.859596,"scheduling_latency_s":1.859625}1270gitlab # [ 259.300343] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.871Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"35e315751fcd0aad500bd85a","created_at":"2026-08-16T17:05:07.906Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6a1dc760537ec1041504f2828bd40ce0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:07.942Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-35e315751fcd0aad500bd85a: done: 0.069686 sec","job_status":"done","queue_duration_s":1.859596,"scheduling_latency_s":1.859625,"redis_calls":12,"redis_duration_s":0.004109,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000579,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001908,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001622,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030899,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00093216,"exclusive_lock_hold_duration_s":0.02959026,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.069686,"completed_at":"2026-08-16T17:05:09.871Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027086,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1271gitlab # [ 259.344925] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.874Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"befa34fbf93dbe590729616a","created_at":"2026-08-16T17:05:08.656Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-ae47ef13a20a4fb1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8d4d994588265d538fd01ea617d35480","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.677Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-befa34fbf93dbe590729616a: start","job_status":"start","queue_duration_s":1.196173,"scheduling_latency_s":1.196204}1272gitlab # [ 259.356907] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.901Z","message":"No existing merge request to be cleaned up."}1273gitlab # [ 259.358515] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.923Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"befa34fbf93dbe590729616a","created_at":"2026-08-16T17:05:08.656Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-ae47ef13a20a4fb1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8d4d994588265d538fd01ea617d35480","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.677Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-befa34fbf93dbe590729616a: done: 0.049208 sec","job_status":"done","queue_duration_s":1.196173,"scheduling_latency_s":1.196204,"redis_calls":13,"redis_duration_s":0.004626,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000657,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002435,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030861,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00067678,"duration_s":0.049208,"completed_at":"2026-08-16T17:05:09.923Z","load_balancing_strategy":"primary","db_duration_s":0.007004,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1274gitlab # [ 259.399356] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.925Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9d18dfe580bb16f3a6d0a0d5","created_at":"2026-08-16T17:05:08.656Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-ae47ef13a20a4fb1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8d4d994588265d538fd01ea617d35480","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.677Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9d18dfe580bb16f3a6d0a0d5: start","job_status":"start","queue_duration_s":1.247468,"scheduling_latency_s":1.247493}1275gitlab # [ 259.411841] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.940Z","message":"No existing merge request to be cleaned up."}1276gitlab # [ 259.413624] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.951Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9d18dfe580bb16f3a6d0a0d5","created_at":"2026-08-16T17:05:08.656Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-ae47ef13a20a4fb1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8d4d994588265d538fd01ea617d35480","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.677Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9d18dfe580bb16f3a6d0a0d5: done: 0.026597 sec","job_status":"done","queue_duration_s":1.247468,"scheduling_latency_s":1.247493,"redis_calls":10,"redis_duration_s":0.002768,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0011,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001668,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017689,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026597,"completed_at":"2026-08-16T17:05:09.951Z","load_balancing_strategy":"primary","db_duration_s":0.002667,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1277gitlab # [ 259.451547] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.953Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"480e5ad3596e0af6b17104c2","created_at":"2026-08-16T17:05:08.656Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-ae47ef13a20a4fb1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8d4d994588265d538fd01ea617d35480","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.677Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-480e5ad3596e0af6b17104c2: start","job_status":"start","queue_duration_s":1.275889,"scheduling_latency_s":1.275911}1278gitlab # [ 259.464057] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.967Z","message":"No existing merge request to be cleaned up."}1279gitlab # [ 259.465695] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.978Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"480e5ad3596e0af6b17104c2","created_at":"2026-08-16T17:05:08.656Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-ae47ef13a20a4fb1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8d4d994588265d538fd01ea617d35480","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.677Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-480e5ad3596e0af6b17104c2: done: 0.024731 sec","job_status":"done","queue_duration_s":1.275889,"scheduling_latency_s":1.275911,"redis_calls":10,"redis_duration_s":0.0028910000000000003,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001164,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001727,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016444,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024731,"completed_at":"2026-08-16T17:05:09.978Z","load_balancing_strategy":"primary","db_duration_s":0.002707,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1280gitlab # [ 259.503885] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.980Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"3ab84fbabcb7c4f7236d5034","created_at":"2026-08-16T17:05:08.656Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-ae47ef13a20a4fb1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8d4d994588265d538fd01ea617d35480","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.677Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-3ab84fbabcb7c4f7236d5034: start","job_status":"start","queue_duration_s":1.302316,"scheduling_latency_s":1.302336}1281gitlab # [ 259.516407] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.992Z","message":"No existing merge request to be cleaned up."}1282gitlab # [ 259.518057] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.002Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"3ab84fbabcb7c4f7236d5034","created_at":"2026-08-16T17:05:08.656Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-ae47ef13a20a4fb1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8d4d994588265d538fd01ea617d35480","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.677Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-3ab84fbabcb7c4f7236d5034: done: 0.022342 sec","job_status":"done","queue_duration_s":1.302316,"scheduling_latency_s":1.302336,"redis_calls":10,"redis_duration_s":0.002584,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001103,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001481,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014376,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022342,"completed_at":"2026-08-16T17:05:10.002Z","load_balancing_strategy":"primary","db_duration_s":0.002491,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1283gitlab # [ 259.556123] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.004Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c441e0db74f908fd5ea0689","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c441e0db74f908fd5ea0689: start","job_status":"start","queue_duration_s":1.140111,"scheduling_latency_s":1.140129}1284gitlab # [ 259.568428] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.027Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c441e0db74f908fd5ea0689","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c441e0db74f908fd5ea0689: done: 0.023481 sec","job_status":"done","queue_duration_s":1.140111,"scheduling_latency_s":1.140129,"redis_calls":16,"redis_duration_s":0.003912,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000494,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001187,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002231,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013793,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003445,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023481,"completed_at":"2026-08-16T17:05:10.027Z","load_balancing_strategy":"primary","db_duration_s":0.000654,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1285gitlab # [ 259.609765] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.029Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c5282663717cb5a4446f8d2c","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c5282663717cb5a4446f8d2c: start","job_status":"start","queue_duration_s":1.16504,"scheduling_latency_s":1.165058}1286gitlab # [ 259.622181] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.044Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c5282663717cb5a4446f8d2c","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c5282663717cb5a4446f8d2c: done: 0.015404 sec","job_status":"done","queue_duration_s":1.16504,"scheduling_latency_s":1.165058,"redis_calls":13,"redis_duration_s":0.002711,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000918,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001793,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009702,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015404,"completed_at":"2026-08-16T17:05:10.044Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1287gitlab # [ 259.660956] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.045Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abc7457e6294002e311b2566","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abc7457e6294002e311b2566: start","job_status":"start","queue_duration_s":1.181758,"scheduling_latency_s":1.181775}1288gitlab # [ 259.673236] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.061Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abc7457e6294002e311b2566","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abc7457e6294002e311b2566: done: 0.015825 sec","job_status":"done","queue_duration_s":1.181758,"scheduling_latency_s":1.181775,"redis_calls":13,"redis_duration_s":0.003009,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000932,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002077,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009533,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015825,"completed_at":"2026-08-16T17:05:10.061Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1289gitlab # [ 259.713230] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.063Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"791394a8def5ed1cfe1d5d85","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-791394a8def5ed1cfe1d5d85: start","job_status":"start","queue_duration_s":1.199057,"scheduling_latency_s":1.199074}1290gitlab # [ 259.725319] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.078Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"791394a8def5ed1cfe1d5d85","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-791394a8def5ed1cfe1d5d85: done: 0.015703 sec","job_status":"done","queue_duration_s":1.199057,"scheduling_latency_s":1.199074,"redis_calls":13,"redis_duration_s":0.003136,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001078,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002058,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009593,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015703,"completed_at":"2026-08-16T17:05:10.078Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1291gitlab # [ 259.764166] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.080Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d379321761472f8069b62ce","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d379321761472f8069b62ce: start","job_status":"start","queue_duration_s":1.216094,"scheduling_latency_s":1.21611}1292gitlab # [ 259.776036] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.095Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d379321761472f8069b62ce","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d379321761472f8069b62ce: done: 0.01529 sec","job_status":"done","queue_duration_s":1.216094,"scheduling_latency_s":1.21611,"redis_calls":13,"redis_duration_s":0.002634,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000902,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001732,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009548,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01529,"completed_at":"2026-08-16T17:05:10.095Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1293gitlab # [ 259.815555] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.096Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bca639117b89b1030127f069","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bca639117b89b1030127f069: start","job_status":"start","queue_duration_s":1.23271,"scheduling_latency_s":1.232727}1294gitlab # [ 259.827658] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.111Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bca639117b89b1030127f069","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bca639117b89b1030127f069: done: 0.015131 sec","job_status":"done","queue_duration_s":1.23271,"scheduling_latency_s":1.232727,"redis_calls":13,"redis_duration_s":0.002837,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000963,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001874,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009339,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015131,"completed_at":"2026-08-16T17:05:10.111Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1295gitlab # [ 259.866495] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.113Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca1a59d0b5c790a027b0940e","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca1a59d0b5c790a027b0940e: start","job_status":"start","queue_duration_s":1.249529,"scheduling_latency_s":1.249547}1296gitlab # [ 259.878498] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.128Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca1a59d0b5c790a027b0940e","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca1a59d0b5c790a027b0940e: done: 0.015207 sec","job_status":"done","queue_duration_s":1.249529,"scheduling_latency_s":1.249547,"redis_calls":13,"redis_duration_s":0.0027949999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000861,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001934,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009395,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015207,"completed_at":"2026-08-16T17:05:10.128Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1297gitlab # [ 259.918228] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.130Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0458cd38132941ead2e64719","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0458cd38132941ead2e64719: start","job_status":"start","queue_duration_s":1.266217,"scheduling_latency_s":1.266234}1298gitlab # [ 259.930906] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.145Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0458cd38132941ead2e64719","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0458cd38132941ead2e64719: done: 0.014959 sec","job_status":"done","queue_duration_s":1.266217,"scheduling_latency_s":1.266234,"redis_calls":13,"redis_duration_s":0.002643,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000911,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001732,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009507,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014959,"completed_at":"2026-08-16T17:05:10.145Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1299gitlab # [ 259.970222] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.146Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"89b97de9ae5036a1d20146b2","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-89b97de9ae5036a1d20146b2: start","job_status":"start","queue_duration_s":1.282635,"scheduling_latency_s":1.282652}1300gitlab # [ 259.982792] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.161Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"89b97de9ae5036a1d20146b2","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-89b97de9ae5036a1d20146b2: done: 0.015298 sec","job_status":"done","queue_duration_s":1.282635,"scheduling_latency_s":1.282652,"redis_calls":13,"redis_duration_s":0.002633,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000903,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00173,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009805,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015298,"completed_at":"2026-08-16T17:05:10.161Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1301gitlab # [ 260.023042] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.163Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28793bd0f2c106d563517349","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28793bd0f2c106d563517349: start","job_status":"start","queue_duration_s":1.299585,"scheduling_latency_s":1.299602}1302gitlab # [ 260.036746] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.179Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28793bd0f2c106d563517349","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28793bd0f2c106d563517349: done: 0.015501 sec","job_status":"done","queue_duration_s":1.299585,"scheduling_latency_s":1.299602,"redis_calls":13,"redis_duration_s":0.002835,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000967,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001868,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009795,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015501,"completed_at":"2026-08-16T17:05:10.178Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1303gitlab # [ 260.077658] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.180Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2760ec79ae878aa050cbac8e","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2760ec79ae878aa050cbac8e: start","job_status":"start","queue_duration_s":1.316564,"scheduling_latency_s":1.316581}1304gitlab # [ 260.090677] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.195Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2760ec79ae878aa050cbac8e","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2760ec79ae878aa050cbac8e: done: 0.015337 sec","job_status":"done","queue_duration_s":1.316564,"scheduling_latency_s":1.316581,"redis_calls":13,"redis_duration_s":0.002734,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000904,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00183,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00973,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015337,"completed_at":"2026-08-16T17:05:10.195Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1305gitlab # [ 260.132387] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.197Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ef379e19d73f69faa1096439","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ef379e19d73f69faa1096439: start","job_status":"start","queue_duration_s":1.333217,"scheduling_latency_s":1.333233}1306gitlab # [ 260.144919] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.212Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ef379e19d73f69faa1096439","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ef379e19d73f69faa1096439: done: 0.015328 sec","job_status":"done","queue_duration_s":1.333217,"scheduling_latency_s":1.333233,"redis_calls":13,"redis_duration_s":0.0027,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000897,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001803,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009636,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015328,"completed_at":"2026-08-16T17:05:10.212Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1307gitlab # [ 260.183721] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.213Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"34ff5a406c683995da2d4a00","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-34ff5a406c683995da2d4a00: start","job_status":"start","queue_duration_s":1.349963,"scheduling_latency_s":1.34998}1308gitlab # [ 260.196302] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.229Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"34ff5a406c683995da2d4a00","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-34ff5a406c683995da2d4a00: done: 0.015429 sec","job_status":"done","queue_duration_s":1.349963,"scheduling_latency_s":1.34998,"redis_calls":13,"redis_duration_s":0.0026579999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000923,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001735,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009592,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015429,"completed_at":"2026-08-16T17:05:10.229Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1309gitlab # [ 260.235971] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.230Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a48c28afc500cef60ea4e063","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a48c28afc500cef60ea4e063: start","job_status":"start","queue_duration_s":1.366795,"scheduling_latency_s":1.366812}1310gitlab # [ 260.248275] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.246Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a48c28afc500cef60ea4e063","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a48c28afc500cef60ea4e063: done: 0.015367 sec","job_status":"done","queue_duration_s":1.366795,"scheduling_latency_s":1.366812,"redis_calls":13,"redis_duration_s":0.002613,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000876,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001737,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009642,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015367,"completed_at":"2026-08-16T17:05:10.246Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1311gitlab # [ 260.288261] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.247Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51cfa9d21bf3bcc92242fbe8","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51cfa9d21bf3bcc92242fbe8: start","job_status":"start","queue_duration_s":1.383561,"scheduling_latency_s":1.383578}1312gitlab # [ 260.300816] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.263Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51cfa9d21bf3bcc92242fbe8","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51cfa9d21bf3bcc92242fbe8: done: 0.015609 sec","job_status":"done","queue_duration_s":1.383561,"scheduling_latency_s":1.383578,"redis_calls":13,"redis_duration_s":0.00277,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000951,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001819,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009657,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015609,"completed_at":"2026-08-16T17:05:10.263Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1313gitlab # [ 260.341141] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.264Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8787ffb22170b9aee7fc00c","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8787ffb22170b9aee7fc00c: start","job_status":"start","queue_duration_s":1.400577,"scheduling_latency_s":1.400594}1314gitlab # [ 260.353824] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.280Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8787ffb22170b9aee7fc00c","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8787ffb22170b9aee7fc00c: done: 0.015851 sec","job_status":"done","queue_duration_s":1.400577,"scheduling_latency_s":1.400594,"redis_calls":13,"redis_duration_s":0.00292,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000984,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001936,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009561,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015851,"completed_at":"2026-08-16T17:05:10.280Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1315gitlab # [ 260.394115] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.281Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"825346ff45a731260180346b","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-825346ff45a731260180346b: start","job_status":"start","queue_duration_s":1.417717,"scheduling_latency_s":1.417734}1316gitlab # [ 260.406223] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.296Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"825346ff45a731260180346b","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-825346ff45a731260180346b: done: 0.015084 sec","job_status":"done","queue_duration_s":1.417717,"scheduling_latency_s":1.417734,"redis_calls":13,"redis_duration_s":0.002725,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000905,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00182,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009384,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015084,"completed_at":"2026-08-16T17:05:10.296Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1317gitlab # [ 260.445609] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.298Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63c7e34ef01081954bf80ab7","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63c7e34ef01081954bf80ab7: start","job_status":"start","queue_duration_s":1.434097,"scheduling_latency_s":1.434113}1318gitlab # [ 260.457918] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.313Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63c7e34ef01081954bf80ab7","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63c7e34ef01081954bf80ab7: done: 0.01525 sec","job_status":"done","queue_duration_s":1.434097,"scheduling_latency_s":1.434113,"redis_calls":13,"redis_duration_s":0.002462,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000901,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001561,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009825,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01525,"completed_at":"2026-08-16T17:05:10.313Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1319gitlab # [ 260.496207] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.314Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"49c9204c28e1286eff3b4b2d","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-49c9204c28e1286eff3b4b2d: start","job_status":"start","queue_duration_s":1.450964,"scheduling_latency_s":1.450981}1320gitlab # [ 260.508265] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.330Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"49c9204c28e1286eff3b4b2d","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-49c9204c28e1286eff3b4b2d: done: 0.015678 sec","job_status":"done","queue_duration_s":1.450964,"scheduling_latency_s":1.450981,"redis_calls":13,"redis_duration_s":0.002915,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001058,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001857,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009809,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015678,"completed_at":"2026-08-16T17:05:10.330Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1321gitlab # [ 260.548258] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.332Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"822bbae6194c87143e2f3c60","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-822bbae6194c87143e2f3c60: start","job_status":"start","queue_duration_s":1.468517,"scheduling_latency_s":1.468535}1322gitlab # [ 260.560946] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.348Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"822bbae6194c87143e2f3c60","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-822bbae6194c87143e2f3c60: done: 0.015614 sec","job_status":"done","queue_duration_s":1.468517,"scheduling_latency_s":1.468535,"redis_calls":13,"redis_duration_s":0.002686,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000943,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001743,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010008,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015614,"completed_at":"2026-08-16T17:05:10.348Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1323gitlab # [ 260.600981] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.349Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7fd8fd4bde6520826406d6fb","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7fd8fd4bde6520826406d6fb: start","job_status":"start","queue_duration_s":1.485678,"scheduling_latency_s":1.485695}1324gitlab # [ 260.614602] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.365Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7fd8fd4bde6520826406d6fb","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7fd8fd4bde6520826406d6fb: done: 0.01634 sec","job_status":"done","queue_duration_s":1.485678,"scheduling_latency_s":1.485695,"redis_calls":13,"redis_duration_s":0.003245,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000966,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002279,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010203,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01634,"completed_at":"2026-08-16T17:05:10.365Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1325gitlab # [ 260.654678] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.367Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"34513c686a3136089ff77a9c","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-34513c686a3136089ff77a9c: start","job_status":"start","queue_duration_s":1.50359,"scheduling_latency_s":1.50361}1326gitlab # [ 260.666824] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.383Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"34513c686a3136089ff77a9c","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-34513c686a3136089ff77a9c: done: 0.01652 sec","job_status":"done","queue_duration_s":1.50359,"scheduling_latency_s":1.50361,"redis_calls":13,"redis_duration_s":0.00281,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000982,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001828,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010642,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01652,"completed_at":"2026-08-16T17:05:10.383Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1327gitlab # [ 260.705650] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.385Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64eb190b8c1dc9aa3530b112","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64eb190b8c1dc9aa3530b112: start","job_status":"start","queue_duration_s":1.521535,"scheduling_latency_s":1.521554}1328gitlab # [ 260.717882] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.402Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64eb190b8c1dc9aa3530b112","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64eb190b8c1dc9aa3530b112: done: 0.016576 sec","job_status":"done","queue_duration_s":1.521535,"scheduling_latency_s":1.521554,"redis_calls":13,"redis_duration_s":0.003018,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000953,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002065,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010435,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016576,"completed_at":"2026-08-16T17:05:10.402Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1329gitlab # [ 260.756473] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.404Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0b9d17c1531e85d371900a05","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0b9d17c1531e85d371900a05: start","job_status":"start","queue_duration_s":1.540505,"scheduling_latency_s":1.540555}1330gitlab # [ 260.768844] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.443Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0b9d17c1531e85d371900a05","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0b9d17c1531e85d371900a05: done: 0.038853 sec","job_status":"done","queue_duration_s":1.540505,"scheduling_latency_s":1.540555,"redis_calls":13,"redis_duration_s":0.0032440000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001185,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002059,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027172,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.038853,"completed_at":"2026-08-16T17:05:10.443Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1331gitlab # [ 260.807712] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.445Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a46e3411f68518c818010cd","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a46e3411f68518c818010cd: start","job_status":"start","queue_duration_s":1.581533,"scheduling_latency_s":1.581566}1332gitlab # [ 260.820906] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.474Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a46e3411f68518c818010cd","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a46e3411f68518c818010cd: done: 0.029007 sec","job_status":"done","queue_duration_s":1.581533,"scheduling_latency_s":1.581566,"redis_calls":13,"redis_duration_s":0.0033610000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001012,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002349,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019072,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029007,"completed_at":"2026-08-16T17:05:10.474Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1333gitlab # [ 260.859842] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.476Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca26a35a167127a90c6dc020","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca26a35a167127a90c6dc020: start","job_status":"start","queue_duration_s":1.612671,"scheduling_latency_s":1.612703}1334gitlab # [ 260.872882] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.504Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca26a35a167127a90c6dc020","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca26a35a167127a90c6dc020: done: 0.027753 sec","job_status":"done","queue_duration_s":1.612671,"scheduling_latency_s":1.612703,"redis_calls":13,"redis_duration_s":0.0035919999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001159,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002433,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017945,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027753,"completed_at":"2026-08-16T17:05:10.504Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1335gitlab # [ 260.912776] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.506Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e06b1449c440a6960da5ed72","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e06b1449c440a6960da5ed72: start","job_status":"start","queue_duration_s":1.642485,"scheduling_latency_s":1.642513}1336gitlab # [ 260.925324] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.530Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e06b1449c440a6960da5ed72","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e06b1449c440a6960da5ed72: done: 0.023698 sec","job_status":"done","queue_duration_s":1.642485,"scheduling_latency_s":1.642513,"redis_calls":13,"redis_duration_s":0.003253,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00111,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002143,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015424,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023698,"completed_at":"2026-08-16T17:05:10.530Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1337gitlab # [ 260.963987] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.532Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"181cc483172f82a639c91b74","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-181cc483172f82a639c91b74: start","job_status":"start","queue_duration_s":1.668154,"scheduling_latency_s":1.668178}1338gitlab # [ 260.975870] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.550Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"181cc483172f82a639c91b74","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-181cc483172f82a639c91b74: done: 0.018796 sec","job_status":"done","queue_duration_s":1.668154,"scheduling_latency_s":1.668178,"redis_calls":13,"redis_duration_s":0.002687,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000972,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001715,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012138,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018796,"completed_at":"2026-08-16T17:05:10.550Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1339gitlab # [ 261.014750] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.552Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c478034e2dddac4234b41f8a","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c478034e2dddac4234b41f8a: start","job_status":"start","queue_duration_s":1.688639,"scheduling_latency_s":1.688659}1340gitlab # [ 261.028066] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.571Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c478034e2dddac4234b41f8a","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c478034e2dddac4234b41f8a: done: 0.018488 sec","job_status":"done","queue_duration_s":1.688639,"scheduling_latency_s":1.688659,"redis_calls":13,"redis_duration_s":0.003267,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000977,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00229,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011281,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018488,"completed_at":"2026-08-16T17:05:10.571Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1341gitlab # [ 261.066874] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.572Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b4d2f940be763bf2c96f4bf","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b4d2f940be763bf2c96f4bf: start","job_status":"start","queue_duration_s":1.708755,"scheduling_latency_s":1.708774}1342gitlab # [ 261.079382] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.590Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b4d2f940be763bf2c96f4bf","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b4d2f940be763bf2c96f4bf: done: 0.017498 sec","job_status":"done","queue_duration_s":1.708755,"scheduling_latency_s":1.708774,"redis_calls":13,"redis_duration_s":0.0029519999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001897,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01138,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017498,"completed_at":"2026-08-16T17:05:10.590Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1343gitlab # [ 261.118438] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.592Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"15a1155f1c8b3c155593e30f","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-15a1155f1c8b3c155593e30f: start","job_status":"start","queue_duration_s":1.728025,"scheduling_latency_s":1.728045}1344gitlab # [ 261.130779] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.608Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"15a1155f1c8b3c155593e30f","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-15a1155f1c8b3c155593e30f: done: 0.016539 sec","job_status":"done","queue_duration_s":1.728025,"scheduling_latency_s":1.728045,"redis_calls":13,"redis_duration_s":0.002778,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000983,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001795,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010598,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016539,"completed_at":"2026-08-16T17:05:10.608Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1345gitlab # [ 261.169552] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.610Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d2a90fe237f3385b16a0f45","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d2a90fe237f3385b16a0f45: start","job_status":"start","queue_duration_s":1.746091,"scheduling_latency_s":1.74611}1346gitlab # [ 261.181917] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.625Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d2a90fe237f3385b16a0f45","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d2a90fe237f3385b16a0f45: done: 0.015769 sec","job_status":"done","queue_duration_s":1.746091,"scheduling_latency_s":1.74611,"redis_calls":13,"redis_duration_s":0.002731,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000906,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001825,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01007,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015769,"completed_at":"2026-08-16T17:05:10.625Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1347gitlab # [ 261.220514] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.627Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c0039795708217d3f451805e","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c0039795708217d3f451805e: start","job_status":"start","queue_duration_s":1.763342,"scheduling_latency_s":1.76336}1348gitlab # [ 261.233690] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.643Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c0039795708217d3f451805e","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c0039795708217d3f451805e: done: 0.016117 sec","job_status":"done","queue_duration_s":1.763342,"scheduling_latency_s":1.76336,"redis_calls":13,"redis_duration_s":0.002789,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000958,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001831,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010211,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016117,"completed_at":"2026-08-16T17:05:10.643Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1349gitlab # [ 261.272265] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.644Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f18f272ea0231fce25be582","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f18f272ea0231fce25be582: start","job_status":"start","queue_duration_s":1.780861,"scheduling_latency_s":1.780877}1350gitlab # [ 261.284153] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.660Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f18f272ea0231fce25be582","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f18f272ea0231fce25be582: done: 0.015792 sec","job_status":"done","queue_duration_s":1.780861,"scheduling_latency_s":1.780877,"redis_calls":13,"redis_duration_s":0.002732,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000922,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00181,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00982,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015792,"completed_at":"2026-08-16T17:05:10.660Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1351gitlab # [ 261.322508] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.661Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c204acfcc775ede6f6ce12f","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c204acfcc775ede6f6ce12f: start","job_status":"start","queue_duration_s":1.798022,"scheduling_latency_s":1.79804}1352gitlab # [ 261.334789] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.678Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c204acfcc775ede6f6ce12f","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c204acfcc775ede6f6ce12f: done: 0.016595 sec","job_status":"done","queue_duration_s":1.798022,"scheduling_latency_s":1.79804,"redis_calls":13,"redis_duration_s":0.002989,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000927,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002062,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010078,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016595,"completed_at":"2026-08-16T17:05:10.678Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1353gitlab # [ 261.374718] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.680Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c69d8dc3c60dbbeb098e924","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c69d8dc3c60dbbeb098e924: start","job_status":"start","queue_duration_s":1.816149,"scheduling_latency_s":1.816167}1354gitlab # [ 261.387714] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.696Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c69d8dc3c60dbbeb098e924","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c69d8dc3c60dbbeb098e924: done: 0.016825 sec","job_status":"done","queue_duration_s":1.816149,"scheduling_latency_s":1.816167,"redis_calls":13,"redis_duration_s":0.002777,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000926,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001851,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01065,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016825,"completed_at":"2026-08-16T17:05:10.696Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1355gitlab # [ 261.427167] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.697Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7913fa699dc908e460aecb63","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7913fa699dc908e460aecb63: start","job_status":"start","queue_duration_s":1.833971,"scheduling_latency_s":1.833988}1356gitlab # [ 261.440319] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.713Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7913fa699dc908e460aecb63","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7913fa699dc908e460aecb63: done: 0.015634 sec","job_status":"done","queue_duration_s":1.833971,"scheduling_latency_s":1.833988,"redis_calls":13,"redis_duration_s":0.001824,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000604,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00122,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010617,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015634,"completed_at":"2026-08-16T17:05:10.713Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1357gitlab # [ 261.479273] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.714Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52670c6da8676f856abc3e9f","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52670c6da8676f856abc3e9f: start","job_status":"start","queue_duration_s":1.850906,"scheduling_latency_s":1.850925}1358gitlab # [ 261.491836] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.730Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52670c6da8676f856abc3e9f","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52670c6da8676f856abc3e9f: done: 0.016002 sec","job_status":"done","queue_duration_s":1.850906,"scheduling_latency_s":1.850925,"redis_calls":13,"redis_duration_s":0.00167,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000691,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000979,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011167,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016002,"completed_at":"2026-08-16T17:05:10.730Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1359gitlab # [ 261.530608] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.732Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51faaf1d87f3b8994feed43d","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51faaf1d87f3b8994feed43d: start","job_status":"start","queue_duration_s":1.868263,"scheduling_latency_s":1.868282}1360gitlab # [ 261.543001] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.749Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51faaf1d87f3b8994feed43d","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51faaf1d87f3b8994feed43d: done: 0.016929 sec","job_status":"done","queue_duration_s":1.868263,"scheduling_latency_s":1.868282,"redis_calls":13,"redis_duration_s":0.001986,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000597,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001389,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011416,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016929,"completed_at":"2026-08-16T17:05:10.749Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1361gitlab # [ 261.581848] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.750Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8bd8185124dca019d1cec274","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8bd8185124dca019d1cec274: start","job_status":"start","queue_duration_s":1.886538,"scheduling_latency_s":1.886557}1362gitlab # [ 261.593915] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.765Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8bd8185124dca019d1cec274","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8bd8185124dca019d1cec274: done: 0.015504 sec","job_status":"done","queue_duration_s":1.886538,"scheduling_latency_s":1.886557,"redis_calls":13,"redis_duration_s":0.0015249999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000977,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01067,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015504,"completed_at":"2026-08-16T17:05:10.765Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1363gitlab # [ 261.633417] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.767Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04de30204efa5a44c012a337","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04de30204efa5a44c012a337: start","job_status":"start","queue_duration_s":1.903371,"scheduling_latency_s":1.90339}1364gitlab # [ 261.645812] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.782Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04de30204efa5a44c012a337","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04de30204efa5a44c012a337: done: 0.014995 sec","job_status":"done","queue_duration_s":1.903371,"scheduling_latency_s":1.90339,"redis_calls":13,"redis_duration_s":0.001441,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010579,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014995,"completed_at":"2026-08-16T17:05:10.782Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1365gitlab # [ 261.684276] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.783Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ae8a58d29d6fc38b5f065a60","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ae8a58d29d6fc38b5f065a60: start","job_status":"start","queue_duration_s":1.919634,"scheduling_latency_s":1.919654}1366gitlab # [ 261.696147] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.798Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ae8a58d29d6fc38b5f065a60","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ae8a58d29d6fc38b5f065a60: done: 0.015378 sec","job_status":"done","queue_duration_s":1.919634,"scheduling_latency_s":1.919654,"redis_calls":13,"redis_duration_s":0.001694,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000726,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000968,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010748,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015378,"completed_at":"2026-08-16T17:05:10.798Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1367gitlab # [ 261.734772] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.800Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52ad8d15c8efd3842e57c81b","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52ad8d15c8efd3842e57c81b: start","job_status":"start","queue_duration_s":1.93606,"scheduling_latency_s":1.936078}1368gitlab # [ 261.747346] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.815Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52ad8d15c8efd3842e57c81b","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52ad8d15c8efd3842e57c81b: done: 0.015094 sec","job_status":"done","queue_duration_s":1.93606,"scheduling_latency_s":1.936078,"redis_calls":13,"redis_duration_s":0.001444,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01046,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015094,"completed_at":"2026-08-16T17:05:10.815Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1369gitlab # [ 261.786212] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.816Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2dc9a2c1d3bc03898ea9b185","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2dc9a2c1d3bc03898ea9b185: start","job_status":"start","queue_duration_s":1.952199,"scheduling_latency_s":1.952217}1370gitlab # [ 261.798332] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.831Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2dc9a2c1d3bc03898ea9b185","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2dc9a2c1d3bc03898ea9b185: done: 0.015159 sec","job_status":"done","queue_duration_s":1.952199,"scheduling_latency_s":1.952217,"redis_calls":13,"redis_duration_s":0.0015329999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000547,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000986,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010332,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015159,"completed_at":"2026-08-16T17:05:10.831Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1371gitlab # [ 261.838094] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.832Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bec266b622cd36b00161e330","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bec266b622cd36b00161e330: start","job_status":"start","queue_duration_s":1.968434,"scheduling_latency_s":1.968452}1372gitlab # [ 261.850486] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.847Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bec266b622cd36b00161e330","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bec266b622cd36b00161e330: done: 0.015192 sec","job_status":"done","queue_duration_s":1.968434,"scheduling_latency_s":1.968452,"redis_calls":13,"redis_duration_s":0.001458,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000542,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010355,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015192,"completed_at":"2026-08-16T17:05:10.847Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1373gitlab # [ 261.889146] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.848Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abbf58a64304539b0b8cd6eb","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abbf58a64304539b0b8cd6eb: start","job_status":"start","queue_duration_s":1.984943,"scheduling_latency_s":1.984962}1374gitlab # [ 261.901220] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.864Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abbf58a64304539b0b8cd6eb","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abbf58a64304539b0b8cd6eb: done: 0.015262 sec","job_status":"done","queue_duration_s":1.984943,"scheduling_latency_s":1.984962,"redis_calls":13,"redis_duration_s":0.001458,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000545,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000913,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010378,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015262,"completed_at":"2026-08-16T17:05:10.864Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1375gitlab # [ 261.940801] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.865Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98c6cbb3a66b2554fa8464c0","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98c6cbb3a66b2554fa8464c0: start","job_status":"start","queue_duration_s":2.001541,"scheduling_latency_s":2.00156}1376gitlab # [ 261.953628] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.880Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98c6cbb3a66b2554fa8464c0","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98c6cbb3a66b2554fa8464c0: done: 0.015186 sec","job_status":"done","queue_duration_s":2.001541,"scheduling_latency_s":2.00156,"redis_calls":13,"redis_duration_s":0.0014819999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000948,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010525,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015186,"completed_at":"2026-08-16T17:05:10.880Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1377gitlab # [ 261.993991] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.882Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"49b194b9f95a1ff59b1c254f","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-49b194b9f95a1ff59b1c254f: start","job_status":"start","queue_duration_s":2.018025,"scheduling_latency_s":2.018044}1378gitlab # [ 262.007044] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.897Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"49b194b9f95a1ff59b1c254f","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-49b194b9f95a1ff59b1c254f: done: 0.015124 sec","job_status":"done","queue_duration_s":2.018025,"scheduling_latency_s":2.018044,"redis_calls":13,"redis_duration_s":0.0015660000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000582,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000984,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01052,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015124,"completed_at":"2026-08-16T17:05:10.897Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1379gitlab # [ 262.047067] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.898Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8619c22a44307eb7cde0f3ad","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8619c22a44307eb7cde0f3ad: start","job_status":"start","queue_duration_s":2.034582,"scheduling_latency_s":2.034603}1380gitlab # [ 262.059630] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.913Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8619c22a44307eb7cde0f3ad","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8619c22a44307eb7cde0f3ad: done: 0.015062 sec","job_status":"done","queue_duration_s":2.034582,"scheduling_latency_s":2.034603,"redis_calls":13,"redis_duration_s":0.001431,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000909,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010522,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015062,"completed_at":"2026-08-16T17:05:10.913Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1381gitlab # [ 262.098811] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.914Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05fb189fb49c1e77bbf1927b","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05fb189fb49c1e77bbf1927b: start","job_status":"start","queue_duration_s":2.050763,"scheduling_latency_s":2.050781}1382gitlab # [ 262.111434] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.929Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05fb189fb49c1e77bbf1927b","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05fb189fb49c1e77bbf1927b: done: 0.015143 sec","job_status":"done","queue_duration_s":2.050763,"scheduling_latency_s":2.050781,"redis_calls":13,"redis_duration_s":0.001478,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000935,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010747,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015143,"completed_at":"2026-08-16T17:05:10.929Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1383gitlab # [ 286.631204] setup-gitlab-start[3064]: W, [2026-08-16T17:05:37.295981 #3064] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1384gitlab # [ 310.413123] redis[787]: 10 changes in 300 seconds. Saving...1385gitlab # [ 310.419426] redis[787]: Background saving started by pid 33421386gitlab # [ 310.423600] redis[3342]: BGSAVE done, 414 keys saved, 0 keys skipped, 110957 bytes written.1387gitlab # [ 310.429304] redis[3342]: DB saved on disk1388gitlab # [ 310.431525] redis[3342]: Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB1389gitlab # [ 310.514686] redis[787]: Background saving terminated with success1390gitlab # [ 311.721174] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:02.385Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"599f3994fba8a79452163ed7","created_at":"2026-08-16T17:06:02.352Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c0309bb794cb150e9464e3bbd1661a54","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.381Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-599f3994fba8a79452163ed7: start","job_status":"start","queue_duration_s":0.003385,"scheduling_latency_s":0.003439}1391gitlab # [ 311.915357] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:02.580Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"599f3994fba8a79452163ed7","created_at":"2026-08-16T17:06:02.352Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c0309bb794cb150e9464e3bbd1661a54","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.381Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-599f3994fba8a79452163ed7: done: 0.194899 sec","job_status":"done","queue_duration_s":0.003385,"scheduling_latency_s":0.003439,"redis_calls":17,"redis_duration_s":0.079578,"redis_read_bytes":905,"redis_write_bytes":1674,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.068189,"redis_feature_flag_read_bytes":898,"redis_feature_flag_write_bytes":790,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.008988,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002401,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.065929,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0010759,"duration_s":0.194899,"completed_at":"2026-08-16T17:06:02.580Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027884,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392gitlab # [ 312.005281] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:02.585Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"bdff8525b9bb98181f9bd2d8","created_at":"2026-08-16T17:06:02.402Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"edd7311bccd875d24de6f1a31c78bbb5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.418Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-bdff8525b9bb98181f9bd2d8: start","job_status":"start","queue_duration_s":0.16627,"scheduling_latency_s":0.166321}1393gitlab # [ 312.022738] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:02.657Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1394gitlab # [ 312.026813] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:02.684Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"bdff8525b9bb98181f9bd2d8","created_at":"2026-08-16T17:06:02.402Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"edd7311bccd875d24de6f1a31c78bbb5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.418Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-bdff8525b9bb98181f9bd2d8: done: 0.099072 sec","job_status":"done","queue_duration_s":0.16627,"scheduling_latency_s":0.166321,"redis_calls":7,"redis_duration_s":0.049031,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.046616,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002415,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025735,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.099072,"completed_at":"2026-08-16T17:06:02.683Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1395gitlab # [ 312.069383] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:02.706Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"6338d1be461babe66a7af2e0","created_at":"2026-08-16T17:06:02.444Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a38cbed24f4e991dab277d58f82b428c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-16T17:06:02.457Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-6338d1be461babe66a7af2e0: start","job_status":"start","queue_duration_s":0.24818,"scheduling_latency_s":0.248236}1396gitlab # [ 312.102457] postgres[858]: [858] LOG: checkpoint starting: time1397gitlab # [ 312.171018] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:02.835Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"6338d1be461babe66a7af2e0","created_at":"2026-08-16T17:06:02.444Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a38cbed24f4e991dab277d58f82b428c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-16T17:06:02.457Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-6338d1be461babe66a7af2e0: done: 0.129917 sec","job_status":"done","queue_duration_s":0.24818,"scheduling_latency_s":0.248236,"redis_calls":8,"redis_duration_s":0.050151,"redis_read_bytes":133,"redis_write_bytes":811,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.018941,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":70,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.027931,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003279,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045016,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.129917,"completed_at":"2026-08-16T17:06:02.835Z","load_balancing_strategy":"primary","db_duration_s":0.008432,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1398gitlab # [ 312.264079] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:02.868Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"a809620a93ee4c65a47ac978","created_at":"2026-08-16T17:06:02.522Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d2eba4bb9739eafcfdc91d40b1180cab","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.531Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-a809620a93ee4c65a47ac978: start","job_status":"start","queue_duration_s":0.336621,"scheduling_latency_s":0.336674}1399gitlab # [ 312.365023] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.029Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"a809620a93ee4c65a47ac978","created_at":"2026-08-16T17:06:02.522Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d2eba4bb9739eafcfdc91d40b1180cab","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.531Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-a809620a93ee4c65a47ac978: done: 0.161827 sec","job_status":"done","queue_duration_s":0.336621,"scheduling_latency_s":0.336674,"redis_calls":9,"redis_duration_s":0.014381,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.007542,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.006839,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031095,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00176822,"exclusive_lock_hold_duration_s":0.01058064,"duration_s":0.161827,"completed_at":"2026-08-16T17:06:03.029Z","load_balancing_strategy":"primary","db_duration_s":0.005307,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1400gitlab # [ 312.455637] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.051Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"4bb950f6761fb7272c21b41a","created_at":"2026-08-16T17:06:02.536Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d940f1513888cc05052abd8b041db3ad","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.592Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-4bb950f6761fb7272c21b41a: start","job_status":"start","queue_duration_s":0.458667,"scheduling_latency_s":0.458756}1401gitlab # [ 312.499743] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.165Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"4bb950f6761fb7272c21b41a","created_at":"2026-08-16T17:06:02.536Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d940f1513888cc05052abd8b041db3ad","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.592Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-4bb950f6761fb7272c21b41a: done: 0.1141 sec","job_status":"done","queue_duration_s":0.458667,"scheduling_latency_s":0.458756,"redis_calls":12,"redis_duration_s":0.002844,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000724,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000505,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00123,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000385,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017931,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00062756,"duration_s":0.1141,"completed_at":"2026-08-16T17:06:03.165Z","load_balancing_strategy":"primary","db_duration_s":0.008294,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1402gitlab # [ 312.553713] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.167Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"603a42dabccb4bb478e76403","created_at":"2026-08-16T17:06:02.653Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"52779b17e216a016a2c53845f7305fca","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.670Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-603a42dabccb4bb478e76403: start","job_status":"start","queue_duration_s":0.496893,"scheduling_latency_s":0.496921}1403gitlab # [ 312.568267] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.186Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"603a42dabccb4bb478e76403","created_at":"2026-08-16T17:06:02.653Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"52779b17e216a016a2c53845f7305fca","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.670Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-603a42dabccb4bb478e76403: done: 0.018941 sec","job_status":"done","queue_duration_s":0.496893,"scheduling_latency_s":0.496921,"redis_calls":7,"redis_duration_s":0.0013629999999999998,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000986,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000377,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012288,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018941,"completed_at":"2026-08-16T17:06:03.186Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404gitlab # [ 312.608749] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.187Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"f63ef6fece2484cdf3c30b29","created_at":"2026-08-16T17:06:02.705Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"458a9265b1301c57a30487b704e7cee1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.712Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-f63ef6fece2484cdf3c30b29: start","job_status":"start","queue_duration_s":0.47483,"scheduling_latency_s":0.474853}1405gitlab # [ 312.622702] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.196Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1406gitlab # [ 312.625920] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.203Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"f63ef6fece2484cdf3c30b29","created_at":"2026-08-16T17:06:02.705Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"458a9265b1301c57a30487b704e7cee1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.712Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-f63ef6fece2484cdf3c30b29: done: 0.015797 sec","job_status":"done","queue_duration_s":0.47483,"scheduling_latency_s":0.474853,"redis_calls":7,"redis_duration_s":0.001126,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000818,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000308,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009935,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015797,"completed_at":"2026-08-16T17:06:03.203Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1407gitlab # [ 312.665716] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.204Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"76be53027cb7567d8f1e1622","created_at":"2026-08-16T17:06:02.776Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9a05ce6243d1955a1ad4e3a74c340748","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.782Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-76be53027cb7567d8f1e1622: start","job_status":"start","queue_duration_s":0.42236,"scheduling_latency_s":0.42238}1408gitlab # [ 312.680639] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.222Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"76be53027cb7567d8f1e1622","created_at":"2026-08-16T17:06:02.776Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9a05ce6243d1955a1ad4e3a74c340748","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.782Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-76be53027cb7567d8f1e1622: done: 0.017678 sec","job_status":"done","queue_duration_s":0.42236,"scheduling_latency_s":0.42238,"redis_calls":7,"redis_duration_s":0.001078,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000778,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0003,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010905,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017678,"completed_at":"2026-08-16T17:06:03.222Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00195,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1409gitlab # [ 312.720496] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.223Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"1d34b90eb1447612ebe92c3b","created_at":"2026-08-16T17:06:02.823Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"187347d2267e6674649076a529590589","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.830Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-1d34b90eb1447612ebe92c3b: start","job_status":"start","queue_duration_s":0.392811,"scheduling_latency_s":0.39283}1410gitlab # [ 312.873719] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.538Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"1d34b90eb1447612ebe92c3b","created_at":"2026-08-16T17:06:02.823Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"187347d2267e6674649076a529590589","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.830Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-1d34b90eb1447612ebe92c3b: done: 0.314806 sec","job_status":"done","queue_duration_s":0.392811,"scheduling_latency_s":0.39283,"redis_calls":11,"redis_duration_s":0.002395,"redis_read_bytes":9,"redis_write_bytes":1262,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00028,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":275,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00113,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000985,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.064,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":130,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.064,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.233841,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00048728,"exclusive_lock_hold_duration_s":0.28894788,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.314806,"completed_at":"2026-08-16T17:06:03.538Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.094301,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1411gitlab # [ 312.966380] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.541Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"5b7351cda009e8c10d7d89ff","created_at":"2026-08-16T17:06:02.852Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3cce495d81e6a945b39a01c2903866f2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.857Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-5b7351cda009e8c10d7d89ff: start","job_status":"start","queue_duration_s":0.684006,"scheduling_latency_s":0.684039}1412gitlab # [ 312.982310] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.581Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"5b7351cda009e8c10d7d89ff","created_at":"2026-08-16T17:06:02.852Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3cce495d81e6a945b39a01c2903866f2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.857Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-5b7351cda009e8c10d7d89ff: done: 0.039209 sec","job_status":"done","queue_duration_s":0.684006,"scheduling_latency_s":0.684039,"redis_calls":14,"redis_duration_s":0.004221,"redis_read_bytes":16,"redis_write_bytes":4030,"redis_queues_calls":2,"redis_queues_duration_s":0.00049,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002712,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001019,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028195,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.039209,"completed_at":"2026-08-16T17:06:03.581Z","load_balancing_strategy":"primary","db_duration_s":0.002356,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1413gitlab # [ 313.023560] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.583Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"c3518e7f7abd1854531fd22d","created_at":"2026-08-16T17:06:02.867Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7c8c010992ccd7334736624b667ecb4f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.874Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-c3518e7f7abd1854531fd22d: start","job_status":"start","queue_duration_s":0.708615,"scheduling_latency_s":0.708639}1414gitlab # [ 313.038184] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.593Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1415gitlab # [ 313.041550] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.599Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"c3518e7f7abd1854531fd22d","created_at":"2026-08-16T17:06:02.867Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7c8c010992ccd7334736624b667ecb4f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.874Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-c3518e7f7abd1854531fd22d: done: 0.016534 sec","job_status":"done","queue_duration_s":0.708615,"scheduling_latency_s":0.708639,"redis_calls":7,"redis_duration_s":0.001885,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001329,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000556,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010054,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016534,"completed_at":"2026-08-16T17:06:03.599Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1416gitlab # [ 313.081809] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.601Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"12c031d7592815d1d108d0d1","created_at":"2026-08-16T17:06:02.897Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"56910d748e29ec8612b561dd2c2d48ac","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.902Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-12c031d7592815d1d108d0d1: start","job_status":"start","queue_duration_s":0.698502,"scheduling_latency_s":0.698522}1417gitlab # [ 313.097327] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.626Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"12c031d7592815d1d108d0d1","created_at":"2026-08-16T17:06:02.897Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"56910d748e29ec8612b561dd2c2d48ac","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.902Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-12c031d7592815d1d108d0d1: done: 0.025276 sec","job_status":"done","queue_duration_s":0.698502,"scheduling_latency_s":0.698522,"redis_calls":10,"redis_duration_s":0.002879,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001667,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001212,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014934,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00675428,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.025276,"completed_at":"2026-08-16T17:06:03.626Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00418,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1418gitlab # [ 313.139533] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.628Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"a0e0ada1ba8ff8006e960b9a","created_at":"2026-08-16T17:06:02.916Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a44bb77272910adc25a2f64dfdf0833f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.926Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-a0e0ada1ba8ff8006e960b9a: start","job_status":"start","queue_duration_s":0.70118,"scheduling_latency_s":0.701199}1419gitlab # [ 313.154543] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.649Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"a0e0ada1ba8ff8006e960b9a","created_at":"2026-08-16T17:06:02.916Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a44bb77272910adc25a2f64dfdf0833f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.926Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-a0e0ada1ba8ff8006e960b9a: done: 0.021169 sec","job_status":"done","queue_duration_s":0.70118,"scheduling_latency_s":0.701199,"redis_calls":12,"redis_duration_s":0.002961,"redis_read_bytes":11,"redis_write_bytes":1247,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000516,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001405,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00104,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":296,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012173,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034168,"extra.object_storage_delete_stale_direct_uploads_worker.total_pending_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.total_deleted_stale_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.execution_timeout":false,"duration_s":0.021169,"completed_at":"2026-08-16T17:06:03.649Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000649,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1420gitlab # [ 313.202267] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.650Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"b3ed9ea87b56f72d6e0b510a","created_at":"2026-08-16T17:06:02.949Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.952Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-b3ed9ea87b56f72d6e0b510a: start","job_status":"start","queue_duration_s":0.698586,"scheduling_latency_s":0.698604}1421gitlab # [ 313.215833] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.743Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"b3ed9ea87b56f72d6e0b510a","created_at":"2026-08-16T17:06:02.949Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.952Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-b3ed9ea87b56f72d6e0b510a: done: 0.092706 sec","job_status":"done","queue_duration_s":0.698586,"scheduling_latency_s":0.698604,"redis_calls":60,"redis_duration_s":0.014381000000000001,"redis_read_bytes":108,"redis_write_bytes":41109,"redis_queues_calls":2,"redis_queues_duration_s":0.000626,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.013161,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000594,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.078936,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.092706,"completed_at":"2026-08-16T17:06:03.743Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1422gitlab # [ 313.256671] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.744Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"597649c222c5bee48dbaf225","created_at":"2026-08-16T17:06:02.955Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"12de21444b9dfb776a3af91eaa5bea6a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.958Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-597649c222c5bee48dbaf225: start","job_status":"start","queue_duration_s":0.785866,"scheduling_latency_s":0.785885}1423gitlab # [ 313.271105] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.752Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1424gitlab # [ 313.274990] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.757Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"597649c222c5bee48dbaf225","created_at":"2026-08-16T17:06:02.955Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"12de21444b9dfb776a3af91eaa5bea6a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.958Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-597649c222c5bee48dbaf225: done: 0.012726 sec","job_status":"done","queue_duration_s":0.785866,"scheduling_latency_s":0.785885,"redis_calls":7,"redis_duration_s":0.001,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000698,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000302,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008157,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012726,"completed_at":"2026-08-16T17:06:03.757Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1425gitlab # [ 313.316517] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.758Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"3683c9bb066dd1939f87e6cb","created_at":"2026-08-16T17:06:02.964Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e1a5e7496b6583c944128fd8a28c8583","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.977Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-3683c9bb066dd1939f87e6cb: start","job_status":"start","queue_duration_s":0.781403,"scheduling_latency_s":0.781421}1426gitlab # [ 313.330326] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.785Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"3683c9bb066dd1939f87e6cb","created_at":"2026-08-16T17:06:02.964Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e1a5e7496b6583c944128fd8a28c8583","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.977Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-3683c9bb066dd1939f87e6cb: done: 0.02651 sec","job_status":"done","queue_duration_s":0.781403,"scheduling_latency_s":0.781421,"redis_calls":7,"redis_duration_s":0.000967,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000703,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000264,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01163,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02651,"completed_at":"2026-08-16T17:06:03.784Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010908,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1427gitlab # [ 313.370311] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.786Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"17dd47b64128c18703515d8e","created_at":"2026-08-16T17:06:02.999Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dc0605b42493989e2e43cbdfca5cdca6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-16T17:06:03.008Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-17dd47b64128c18703515d8e: start","job_status":"start","queue_duration_s":0.777401,"scheduling_latency_s":0.77742}1428gitlab # [ 313.383708] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.793Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1429gitlab # [ 313.387165] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.798Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"17dd47b64128c18703515d8e","created_at":"2026-08-16T17:06:02.999Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dc0605b42493989e2e43cbdfca5cdca6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-16T17:06:03.008Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-17dd47b64128c18703515d8e: done: 0.0123 sec","job_status":"done","queue_duration_s":0.777401,"scheduling_latency_s":0.77742,"redis_calls":7,"redis_duration_s":0.0009170000000000001,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000657,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00026,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007924,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.0123,"completed_at":"2026-08-16T17:06:03.798Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1430gitlab # [ 313.426418] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.799Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"68f43158de1c8a351814ff78","created_at":"2026-08-16T17:06:03.023Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"18c65d303ef3dcf21ad392013c36ddd6","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.039Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-68f43158de1c8a351814ff78: start","job_status":"start","queue_duration_s":0.759584,"scheduling_latency_s":0.759602}1431gitlab # [ 313.440944] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.893Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"68f43158de1c8a351814ff78","created_at":"2026-08-16T17:06:03.023Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"18c65d303ef3dcf21ad392013c36ddd6","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.039Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-68f43158de1c8a351814ff78: done: 0.093931 sec","job_status":"done","queue_duration_s":0.759584,"scheduling_latency_s":0.759602,"redis_calls":12,"redis_duration_s":0.001707,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000293,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000765,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000649,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.078249,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00047626,"exclusive_lock_hold_duration_s":0.008789219999999999,"duration_s":0.093931,"completed_at":"2026-08-16T17:06:03.893Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006423,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1432gitlab # [ 313.483353] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.894Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"346ed63b10f5a54720544d18","created_at":"2026-08-16T17:06:03.050Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a954788c52798d154e5949a470d83e38","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.056Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-346ed63b10f5a54720544d18: start","job_status":"start","queue_duration_s":0.838475,"scheduling_latency_s":0.838498}1433gitlab # [ 313.498882] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.913Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"346ed63b10f5a54720544d18","created_at":"2026-08-16T17:06:03.050Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a954788c52798d154e5949a470d83e38","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.056Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-346ed63b10f5a54720544d18: done: 0.018354 sec","job_status":"done","queue_duration_s":0.838475,"scheduling_latency_s":0.838498,"redis_calls":9,"redis_duration_s":0.001528,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000764,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000764,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011239,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000563,"exclusive_lock_hold_duration_s":0.00395622,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.018354,"completed_at":"2026-08-16T17:06:03.913Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00195,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1434gitlab # [ 313.540082] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.915Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"f8ae5e7a6e3a0a96029f0908","created_at":"2026-08-16T17:06:03.065Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c317cace80fb075810cf21f115f542ac","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.068Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-f8ae5e7a6e3a0a96029f0908: start","job_status":"start","queue_duration_s":0.846326,"scheduling_latency_s":0.846346}1435gitlab # [ 313.585751] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.251Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"f8ae5e7a6e3a0a96029f0908","created_at":"2026-08-16T17:06:03.065Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c317cace80fb075810cf21f115f542ac","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.068Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-f8ae5e7a6e3a0a96029f0908: done: 0.336257 sec","job_status":"done","queue_duration_s":0.846326,"scheduling_latency_s":0.846346,"redis_calls":562,"redis_duration_s":0.0606,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000828,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.059772,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.312003,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.336257,"completed_at":"2026-08-16T17:06:04.251Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1436gitlab # [ 313.627746] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.252Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"422af92d56415e5f98fbb4b7","created_at":"2026-08-16T17:06:03.089Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7179cea92bf5242d52a94fc6954d24d4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.092Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-422af92d56415e5f98fbb4b7: start","job_status":"start","queue_duration_s":1.16021,"scheduling_latency_s":1.160237}1437gitlab # [ 313.642296] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.267Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"422af92d56415e5f98fbb4b7","created_at":"2026-08-16T17:06:03.089Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7179cea92bf5242d52a94fc6954d24d4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.092Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-422af92d56415e5f98fbb4b7: done: 0.014659 sec","job_status":"done","queue_duration_s":1.16021,"scheduling_latency_s":1.160237,"redis_calls":7,"redis_duration_s":0.000988,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000714,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000274,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009699,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014659,"completed_at":"2026-08-16T17:06:04.267Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1438gitlab # [ 313.682394] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.268Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"c878bb480f011f8a0c8d5276","created_at":"2026-08-16T17:06:03.106Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c083783c7e641bf8e3d72e7337326fc8","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.109Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-c878bb480f011f8a0c8d5276: start","job_status":"start","queue_duration_s":1.158633,"scheduling_latency_s":1.158651}1439gitlab # [ 313.697664] gitaly[923]: time="2026-08-16T17:06:04.268Z" level=info msg="burden monitor stats" pid=9231440gitlab # [ 313.698903] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.300Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"c878bb480f011f8a0c8d5276","created_at":"2026-08-16T17:06:03.106Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c083783c7e641bf8e3d72e7337326fc8","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.109Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-c878bb480f011f8a0c8d5276: done: 0.03146 sec","job_status":"done","queue_duration_s":1.158633,"scheduling_latency_s":1.158651,"redis_calls":7,"redis_duration_s":0.001827,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000726,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001101,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011037,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.03146,"completed_at":"2026-08-16T17:06:04.299Z","load_balancing_strategy":"primary","db_duration_s":0.016036,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1441gitlab # [ 313.739859] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.301Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"21fd665756c0a3e68e767956","created_at":"2026-08-16T17:06:03.112Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"00a2eecf44a0c1d895ad64a8bb4e18cf","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.115Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-21fd665756c0a3e68e767956: start","job_status":"start","queue_duration_s":1.185529,"scheduling_latency_s":1.185548}1442gitlab # [ 313.754284] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.382Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"21fd665756c0a3e68e767956","created_at":"2026-08-16T17:06:03.112Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"00a2eecf44a0c1d895ad64a8bb4e18cf","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.115Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-21fd665756c0a3e68e767956: done: 0.081547 sec","job_status":"done","queue_duration_s":1.185529,"scheduling_latency_s":1.185548,"redis_calls":9,"redis_duration_s":0.001657,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000863,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000794,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.032,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.032,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029359,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00050296,"exclusive_lock_hold_duration_s":0.06401224,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.081547,"completed_at":"2026-08-16T17:06:04.382Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.054174,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1443gitlab # [ 313.797196] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.384Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"622f96f1672e629ec782b19c","created_at":"2026-08-16T17:06:03.123Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8680bbc40a2ba3a8e708872d9964011f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-16T17:06:03.127Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-622f96f1672e629ec782b19c: start","job_status":"start","queue_duration_s":1.25648,"scheduling_latency_s":1.256506}1444gitlab # [ 313.810246] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.395Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1445gitlab # [ 313.813955] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.402Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"622f96f1672e629ec782b19c","created_at":"2026-08-16T17:06:03.123Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8680bbc40a2ba3a8e708872d9964011f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-16T17:06:03.127Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-622f96f1672e629ec782b19c: done: 0.017914 sec","job_status":"done","queue_duration_s":1.25648,"scheduling_latency_s":1.256506,"redis_calls":7,"redis_duration_s":0.001294,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000913,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000381,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010647,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017914,"completed_at":"2026-08-16T17:06:04.402Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1446gitlab # [ 313.855586] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.403Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"34043771627ca0aba57ff443","created_at":"2026-08-16T17:06:03.131Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"be897c3caf166ce6a16312d98e9d41ba","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.141Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-34043771627ca0aba57ff443: start","job_status":"start","queue_duration_s":1.261725,"scheduling_latency_s":1.261746}1447gitlab # [ 313.870883] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.457Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"34043771627ca0aba57ff443","created_at":"2026-08-16T17:06:03.131Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"be897c3caf166ce6a16312d98e9d41ba","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.141Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-34043771627ca0aba57ff443: done: 0.054295 sec","job_status":"done","queue_duration_s":1.261725,"scheduling_latency_s":1.261746,"redis_calls":9,"redis_duration_s":0.0017920000000000002,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000929,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000863,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025855,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00058952,"exclusive_lock_hold_duration_s":0.02646452,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.054295,"completed_at":"2026-08-16T17:06:04.457Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.022234,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1448gitlab # [ 313.915694] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.459Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"19b4c5a15156cbca62fcb43a","created_at":"2026-08-16T17:06:03.559Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-a3d3f514692e4ce4","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3cce495d81e6a945b39a01c2903866f2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.573Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-19b4c5a15156cbca62fcb43a: start","job_status":"start","queue_duration_s":0.886095,"scheduling_latency_s":0.886122}1449gitlab # [ 313.928324] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.476Z","message":"No existing merge request to be cleaned up."}1450gitlab # [ 313.929917] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.486Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"19b4c5a15156cbca62fcb43a","created_at":"2026-08-16T17:06:03.559Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-a3d3f514692e4ce4","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3cce495d81e6a945b39a01c2903866f2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.573Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-19b4c5a15156cbca62fcb43a: done: 0.026725 sec","job_status":"done","queue_duration_s":0.886095,"scheduling_latency_s":0.886122,"redis_calls":10,"redis_duration_s":0.001791,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000757,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001034,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018617,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026725,"completed_at":"2026-08-16T17:06:04.486Z","load_balancing_strategy":"primary","db_duration_s":0.003086,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1451gitlab # [ 313.968730] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.487Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"166920d0fbb669fad01fb5bd","created_at":"2026-08-16T17:06:03.559Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-a3d3f514692e4ce4","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3cce495d81e6a945b39a01c2903866f2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.573Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-166920d0fbb669fad01fb5bd: start","job_status":"start","queue_duration_s":0.914167,"scheduling_latency_s":0.914189}1452gitlab # [ 313.980916] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.502Z","message":"No existing merge request to be cleaned up."}1453gitlab # [ 313.982620] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.513Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"166920d0fbb669fad01fb5bd","created_at":"2026-08-16T17:06:03.559Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-a3d3f514692e4ce4","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3cce495d81e6a945b39a01c2903866f2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.573Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-166920d0fbb669fad01fb5bd: done: 0.026221 sec","job_status":"done","queue_duration_s":0.914167,"scheduling_latency_s":0.914189,"redis_calls":10,"redis_duration_s":0.002735,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001743,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000992,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017652,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026221,"completed_at":"2026-08-16T17:06:04.513Z","load_balancing_strategy":"primary","db_duration_s":0.002927,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1454gitlab # [ 314.021606] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.515Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0b12fb7003544c5c6d1a5c33","created_at":"2026-08-16T17:06:03.559Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-a3d3f514692e4ce4","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3cce495d81e6a945b39a01c2903866f2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.573Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0b12fb7003544c5c6d1a5c33: start","job_status":"start","queue_duration_s":0.941758,"scheduling_latency_s":0.941779}1455gitlab # [ 314.034201] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.528Z","message":"No existing merge request to be cleaned up."}1456gitlab # [ 314.035853] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.538Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0b12fb7003544c5c6d1a5c33","created_at":"2026-08-16T17:06:03.559Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-a3d3f514692e4ce4","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3cce495d81e6a945b39a01c2903866f2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.573Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0b12fb7003544c5c6d1a5c33: done: 0.022771 sec","job_status":"done","queue_duration_s":0.941758,"scheduling_latency_s":0.941779,"redis_calls":10,"redis_duration_s":0.001489,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000622,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000867,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015415,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022771,"completed_at":"2026-08-16T17:06:04.538Z","load_balancing_strategy":"primary","db_duration_s":0.003496,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1457gitlab # [ 314.075057] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.539Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9b92ee9b6ec106464dc54d81","created_at":"2026-08-16T17:06:03.559Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-a3d3f514692e4ce4","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3cce495d81e6a945b39a01c2903866f2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.573Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9b92ee9b6ec106464dc54d81: start","job_status":"start","queue_duration_s":0.965764,"scheduling_latency_s":0.965783}1458gitlab # [ 314.087710] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.551Z","message":"No existing merge request to be cleaned up."}1459gitlab # [ 314.089518] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.560Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9b92ee9b6ec106464dc54d81","created_at":"2026-08-16T17:06:03.559Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-a3d3f514692e4ce4","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3cce495d81e6a945b39a01c2903866f2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.573Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9b92ee9b6ec106464dc54d81: done: 0.021471 sec","job_status":"done","queue_duration_s":0.965764,"scheduling_latency_s":0.965783,"redis_calls":10,"redis_duration_s":0.001435,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000588,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000847,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013523,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021471,"completed_at":"2026-08-16T17:06:04.560Z","load_balancing_strategy":"primary","db_duration_s":0.002342,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1460gitlab # [ 314.129173] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.562Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"499ae74354ad8a001517f222","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-499ae74354ad8a001517f222: start","job_status":"start","queue_duration_s":0.826091,"scheduling_latency_s":0.82611}1461gitlab # [ 314.141596] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.577Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"499ae74354ad8a001517f222","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-499ae74354ad8a001517f222: done: 0.015721 sec","job_status":"done","queue_duration_s":0.826091,"scheduling_latency_s":0.82611,"redis_calls":13,"redis_duration_s":0.0014910000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000951,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011049,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015721,"completed_at":"2026-08-16T17:06:04.577Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1462gitlab # [ 314.181074] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.578Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b7aef60dcc2453f69c6dfe2f","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b7aef60dcc2453f69c6dfe2f: start","job_status":"start","queue_duration_s":0.842915,"scheduling_latency_s":0.842932}1463gitlab # [ 314.193399] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.594Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b7aef60dcc2453f69c6dfe2f","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b7aef60dcc2453f69c6dfe2f: done: 0.015282 sec","job_status":"done","queue_duration_s":0.842915,"scheduling_latency_s":0.842932,"redis_calls":13,"redis_duration_s":0.0014789999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000972,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010872,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015282,"completed_at":"2026-08-16T17:06:04.594Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1464gitlab # [ 314.232394] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.595Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a234a90ccd08557e1b48a2b","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a234a90ccd08557e1b48a2b: start","job_status":"start","queue_duration_s":0.85929,"scheduling_latency_s":0.859308}1465gitlab # [ 314.244630] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.611Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a234a90ccd08557e1b48a2b","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a234a90ccd08557e1b48a2b: done: 0.01681 sec","job_status":"done","queue_duration_s":0.85929,"scheduling_latency_s":0.859308,"redis_calls":13,"redis_duration_s":0.001644,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001123,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009958,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01681,"completed_at":"2026-08-16T17:06:04.611Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1466gitlab # [ 314.283304] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.613Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c81703c6ebb70307f5b16378","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c81703c6ebb70307f5b16378: start","job_status":"start","queue_duration_s":0.877177,"scheduling_latency_s":0.877196}1467gitlab # [ 314.295614] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.630Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c81703c6ebb70307f5b16378","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c81703c6ebb70307f5b16378: done: 0.016965 sec","job_status":"done","queue_duration_s":0.877177,"scheduling_latency_s":0.877196,"redis_calls":13,"redis_duration_s":0.001437,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000917,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009751,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016965,"completed_at":"2026-08-16T17:06:04.629Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1468gitlab # [ 314.335516] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.631Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e9b7bf3cab1aaf8220f3ad3c","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e9b7bf3cab1aaf8220f3ad3c: start","job_status":"start","queue_duration_s":0.895258,"scheduling_latency_s":0.895276}1469gitlab # [ 314.347973] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.646Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e9b7bf3cab1aaf8220f3ad3c","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e9b7bf3cab1aaf8220f3ad3c: done: 0.014944 sec","job_status":"done","queue_duration_s":0.895258,"scheduling_latency_s":0.895276,"redis_calls":13,"redis_duration_s":0.001448,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000902,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010611,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014944,"completed_at":"2026-08-16T17:06:04.646Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1470gitlab # [ 314.386846] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.647Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d28b3c7c8eed3a661b431399","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d28b3c7c8eed3a661b431399: start","job_status":"start","queue_duration_s":0.91127,"scheduling_latency_s":0.911288}1471gitlab # [ 314.399233] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.662Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d28b3c7c8eed3a661b431399","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d28b3c7c8eed3a661b431399: done: 0.015123 sec","job_status":"done","queue_duration_s":0.91127,"scheduling_latency_s":0.911288,"redis_calls":13,"redis_duration_s":0.001422,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000915,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010747,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015123,"completed_at":"2026-08-16T17:06:04.662Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1472gitlab # [ 314.437911] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.663Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"92c33e5163a8dbc18bbe34a0","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-92c33e5163a8dbc18bbe34a0: start","job_status":"start","queue_duration_s":0.927483,"scheduling_latency_s":0.9275}1473gitlab # [ 314.450221] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.678Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"92c33e5163a8dbc18bbe34a0","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-92c33e5163a8dbc18bbe34a0: done: 0.015066 sec","job_status":"done","queue_duration_s":0.927483,"scheduling_latency_s":0.9275,"redis_calls":13,"redis_duration_s":0.0014659999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000561,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000905,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010685,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015066,"completed_at":"2026-08-16T17:06:04.678Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1474gitlab # [ 314.489298] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.679Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"955f0b6f96f28294a3d24a9d","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-955f0b6f96f28294a3d24a9d: start","job_status":"start","queue_duration_s":0.943593,"scheduling_latency_s":0.943611}1475gitlab # [ 314.501824] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.696Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"955f0b6f96f28294a3d24a9d","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-955f0b6f96f28294a3d24a9d: done: 0.016619 sec","job_status":"done","queue_duration_s":0.943593,"scheduling_latency_s":0.943611,"redis_calls":13,"redis_duration_s":0.001433,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000909,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00965,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016619,"completed_at":"2026-08-16T17:06:04.696Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1476gitlab # [ 314.541746] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.697Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"007435a628d3653f74163fc0","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-007435a628d3653f74163fc0: start","job_status":"start","queue_duration_s":0.961305,"scheduling_latency_s":0.961323}1477gitlab # [ 314.553938] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.712Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"007435a628d3653f74163fc0","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-007435a628d3653f74163fc0: done: 0.015426 sec","job_status":"done","queue_duration_s":0.961305,"scheduling_latency_s":0.961323,"redis_calls":13,"redis_duration_s":0.001568,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000636,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000932,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010851,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015426,"completed_at":"2026-08-16T17:06:04.712Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1478gitlab # [ 314.592719] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.713Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1795a6899bdfc9c33cd9a4a9","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1795a6899bdfc9c33cd9a4a9: start","job_status":"start","queue_duration_s":0.977794,"scheduling_latency_s":0.977812}1479gitlab # [ 314.604659] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.728Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1795a6899bdfc9c33cd9a4a9","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1795a6899bdfc9c33cd9a4a9: done: 0.014813 sec","job_status":"done","queue_duration_s":0.977794,"scheduling_latency_s":0.977812,"redis_calls":13,"redis_duration_s":0.001497,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000571,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000926,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010507,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014813,"completed_at":"2026-08-16T17:06:04.728Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1480gitlab # [ 314.643660] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.729Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2636de978f5cc52d48f35f1","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2636de978f5cc52d48f35f1: start","job_status":"start","queue_duration_s":0.993657,"scheduling_latency_s":0.993674}1481gitlab # [ 314.655936] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.744Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2636de978f5cc52d48f35f1","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2636de978f5cc52d48f35f1: done: 0.014721 sec","job_status":"done","queue_duration_s":0.993657,"scheduling_latency_s":0.993674,"redis_calls":13,"redis_duration_s":0.001418,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000495,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000923,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009634,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014721,"completed_at":"2026-08-16T17:06:04.744Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1482gitlab # [ 314.694647] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.746Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c5441e10dc35a17dc66b0438","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c5441e10dc35a17dc66b0438: start","job_status":"start","queue_duration_s":1.010193,"scheduling_latency_s":1.010211}1483gitlab # [ 314.707888] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.761Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c5441e10dc35a17dc66b0438","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c5441e10dc35a17dc66b0438: done: 0.015142 sec","job_status":"done","queue_duration_s":1.010193,"scheduling_latency_s":1.010211,"redis_calls":13,"redis_duration_s":0.001464,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000954,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010699,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015142,"completed_at":"2026-08-16T17:06:04.761Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1484gitlab # [ 314.748280] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.762Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bc94ef389fba6250f2c21801","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bc94ef389fba6250f2c21801: start","job_status":"start","queue_duration_s":1.026426,"scheduling_latency_s":1.026444}1485gitlab # [ 314.760503] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.777Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bc94ef389fba6250f2c21801","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bc94ef389fba6250f2c21801: done: 0.014893 sec","job_status":"done","queue_duration_s":1.026426,"scheduling_latency_s":1.026444,"redis_calls":13,"redis_duration_s":0.001462,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000953,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010631,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014893,"completed_at":"2026-08-16T17:06:04.777Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1486gitlab # [ 314.799646] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.778Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91194236bac60fef71d6daad","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91194236bac60fef71d6daad: start","job_status":"start","queue_duration_s":1.04239,"scheduling_latency_s":1.042408}1487gitlab # [ 314.812533] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.793Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91194236bac60fef71d6daad","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91194236bac60fef71d6daad: done: 0.01491 sec","job_status":"done","queue_duration_s":1.04239,"scheduling_latency_s":1.042408,"redis_calls":13,"redis_duration_s":0.001414,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000883,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010643,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01491,"completed_at":"2026-08-16T17:06:04.793Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1488gitlab # [ 314.852411] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.794Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d46a5d748474767f48c819aa","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d46a5d748474767f48c819aa: start","job_status":"start","queue_duration_s":1.058422,"scheduling_latency_s":1.05844}1489gitlab # [ 314.865026] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.809Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d46a5d748474767f48c819aa","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d46a5d748474767f48c819aa: done: 0.015212 sec","job_status":"done","queue_duration_s":1.058422,"scheduling_latency_s":1.05844,"redis_calls":13,"redis_duration_s":0.001436,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000901,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009666,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015212,"completed_at":"2026-08-16T17:06:04.809Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1490gitlab # [ 314.904669] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.811Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8da85c8c5dbda69d6b072d03","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8da85c8c5dbda69d6b072d03: start","job_status":"start","queue_duration_s":1.07564,"scheduling_latency_s":1.075657}1491gitlab # [ 314.918196] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.826Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8da85c8c5dbda69d6b072d03","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8da85c8c5dbda69d6b072d03: done: 0.015177 sec","job_status":"done","queue_duration_s":1.07564,"scheduling_latency_s":1.075657,"redis_calls":13,"redis_duration_s":0.0014520000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000558,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000894,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01072,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015177,"completed_at":"2026-08-16T17:06:04.826Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1492gitlab # [ 314.958391] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.827Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f31aed4356a396784387f7d3","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f31aed4356a396784387f7d3: start","job_status":"start","queue_duration_s":1.091863,"scheduling_latency_s":1.09188}1493gitlab # [ 314.971093] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.843Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f31aed4356a396784387f7d3","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f31aed4356a396784387f7d3: done: 0.015324 sec","job_status":"done","queue_duration_s":1.091863,"scheduling_latency_s":1.09188,"redis_calls":13,"redis_duration_s":0.001514,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00098,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010964,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015324,"completed_at":"2026-08-16T17:06:04.843Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1494gitlab # [ 315.010988] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.844Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"adccb0e0fee5d5ce7a5fd26d","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-adccb0e0fee5d5ce7a5fd26d: start","job_status":"start","queue_duration_s":1.108251,"scheduling_latency_s":1.10827}1495gitlab # [ 315.023280] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.859Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"adccb0e0fee5d5ce7a5fd26d","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-adccb0e0fee5d5ce7a5fd26d: done: 0.015308 sec","job_status":"done","queue_duration_s":1.108251,"scheduling_latency_s":1.10827,"redis_calls":13,"redis_duration_s":0.001492,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000965,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010853,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015308,"completed_at":"2026-08-16T17:06:04.859Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1496gitlab # [ 315.063527] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.860Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea579b0dda34c10696617b38","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea579b0dda34c10696617b38: start","job_status":"start","queue_duration_s":1.124596,"scheduling_latency_s":1.124613}1497gitlab # [ 315.076414] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.875Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea579b0dda34c10696617b38","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea579b0dda34c10696617b38: done: 0.014983 sec","job_status":"done","queue_duration_s":1.124596,"scheduling_latency_s":1.124613,"redis_calls":13,"redis_duration_s":0.001397,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000888,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009645,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014983,"completed_at":"2026-08-16T17:06:04.875Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1498gitlab # [ 315.116057] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.877Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39e624be0b0db1d8be552c82","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39e624be0b0db1d8be552c82: start","job_status":"start","queue_duration_s":1.141602,"scheduling_latency_s":1.14162}1499gitlab # [ 315.129136] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.892Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39e624be0b0db1d8be552c82","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39e624be0b0db1d8be552c82: done: 0.015311 sec","job_status":"done","queue_duration_s":1.141602,"scheduling_latency_s":1.14162,"redis_calls":13,"redis_duration_s":0.0014810000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000566,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000915,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010941,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015311,"completed_at":"2026-08-16T17:06:04.892Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1500gitlab # [ 315.168029] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.893Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"73a566574023ba427b53c069","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-73a566574023ba427b53c069: start","job_status":"start","queue_duration_s":1.158016,"scheduling_latency_s":1.158033}1501gitlab # [ 315.180112] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.909Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"73a566574023ba427b53c069","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-73a566574023ba427b53c069: done: 0.015589 sec","job_status":"done","queue_duration_s":1.158016,"scheduling_latency_s":1.158033,"redis_calls":13,"redis_duration_s":0.001451,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000931,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011049,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015589,"completed_at":"2026-08-16T17:06:04.909Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1502gitlab # [ 315.219224] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.910Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"462a3ac032732f67098e794d","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-462a3ac032732f67098e794d: start","job_status":"start","queue_duration_s":1.174697,"scheduling_latency_s":1.174714}1503gitlab # [ 315.232005] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.925Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"462a3ac032732f67098e794d","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-462a3ac032732f67098e794d: done: 0.015202 sec","job_status":"done","queue_duration_s":1.174697,"scheduling_latency_s":1.174714,"redis_calls":13,"redis_duration_s":0.001422,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000904,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010826,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015202,"completed_at":"2026-08-16T17:06:04.925Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1504gitlab # [ 315.271958] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.926Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"79e769f3571b3035a2435123","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-79e769f3571b3035a2435123: start","job_status":"start","queue_duration_s":1.191002,"scheduling_latency_s":1.191019}1505gitlab # [ 315.284338] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.943Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"79e769f3571b3035a2435123","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-79e769f3571b3035a2435123: done: 0.016576 sec","job_status":"done","queue_duration_s":1.191002,"scheduling_latency_s":1.191019,"redis_calls":13,"redis_duration_s":0.0014629999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000915,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009585,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016576,"completed_at":"2026-08-16T17:06:04.943Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1506gitlab # [ 315.324150] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.944Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ef94e5eba27fcbdc05580cf","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ef94e5eba27fcbdc05580cf: start","job_status":"start","queue_duration_s":1.208635,"scheduling_latency_s":1.208652}1507gitlab # [ 315.337304] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.960Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ef94e5eba27fcbdc05580cf","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ef94e5eba27fcbdc05580cf: done: 0.015761 sec","job_status":"done","queue_duration_s":1.208635,"scheduling_latency_s":1.208652,"redis_calls":13,"redis_duration_s":0.0014290000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00088,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011024,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015761,"completed_at":"2026-08-16T17:06:04.960Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1508gitlab # [ 315.377126] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.961Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1d62365ec3bf30718874f500","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1d62365ec3bf30718874f500: start","job_status":"start","queue_duration_s":1.2255,"scheduling_latency_s":1.225518}1509gitlab # [ 315.389733] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.976Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1d62365ec3bf30718874f500","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1d62365ec3bf30718874f500: done: 0.014961 sec","job_status":"done","queue_duration_s":1.2255,"scheduling_latency_s":1.225518,"redis_calls":13,"redis_duration_s":0.0014529999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000935,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010616,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014961,"completed_at":"2026-08-16T17:06:04.976Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1510gitlab # [ 315.429484] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.977Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"294ed7b57756a69c747678cb","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-294ed7b57756a69c747678cb: start","job_status":"start","queue_duration_s":1.241539,"scheduling_latency_s":1.241556}1511gitlab # [ 315.441814] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.992Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"294ed7b57756a69c747678cb","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-294ed7b57756a69c747678cb: done: 0.014941 sec","job_status":"done","queue_duration_s":1.241539,"scheduling_latency_s":1.241556,"redis_calls":13,"redis_duration_s":0.001431,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000492,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000939,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010629,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014941,"completed_at":"2026-08-16T17:06:04.992Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1512gitlab # [ 315.481360] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.993Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ceadc2442b376d5ed8f8ed6","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ceadc2442b376d5ed8f8ed6: start","job_status":"start","queue_duration_s":1.257575,"scheduling_latency_s":1.257593}1513gitlab # [ 315.493980] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.008Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ceadc2442b376d5ed8f8ed6","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ceadc2442b376d5ed8f8ed6: done: 0.015316 sec","job_status":"done","queue_duration_s":1.257575,"scheduling_latency_s":1.257593,"redis_calls":13,"redis_duration_s":0.00143,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000924,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00974,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015316,"completed_at":"2026-08-16T17:06:05.008Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1514gitlab # [ 315.534296] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.010Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3452db7b716ae4859a44b135","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3452db7b716ae4859a44b135: start","job_status":"start","queue_duration_s":1.274237,"scheduling_latency_s":1.274256}1515gitlab # [ 315.546856] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.025Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3452db7b716ae4859a44b135","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3452db7b716ae4859a44b135: done: 0.01513 sec","job_status":"done","queue_duration_s":1.274237,"scheduling_latency_s":1.274256,"redis_calls":13,"redis_duration_s":0.0014750000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000951,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010693,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01513,"completed_at":"2026-08-16T17:06:05.025Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1516gitlab # [ 315.586809] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.026Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7101002f8fa0309805ca28aa","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7101002f8fa0309805ca28aa: start","job_status":"start","queue_duration_s":1.290446,"scheduling_latency_s":1.290463}1517gitlab # [ 315.599244] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.041Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7101002f8fa0309805ca28aa","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7101002f8fa0309805ca28aa: done: 0.014836 sec","job_status":"done","queue_duration_s":1.290446,"scheduling_latency_s":1.290463,"redis_calls":13,"redis_duration_s":0.001396,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000883,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010518,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014836,"completed_at":"2026-08-16T17:06:05.041Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1518gitlab # [ 315.638146] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.042Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"12412557c66a197bca4440f5","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-12412557c66a197bca4440f5: start","job_status":"start","queue_duration_s":1.306389,"scheduling_latency_s":1.306407}1519gitlab # [ 315.650182] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.057Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"12412557c66a197bca4440f5","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-12412557c66a197bca4440f5: done: 0.015206 sec","job_status":"done","queue_duration_s":1.306389,"scheduling_latency_s":1.306407,"redis_calls":13,"redis_duration_s":0.001441,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000919,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010815,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015206,"completed_at":"2026-08-16T17:06:05.057Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1520gitlab # [ 315.688581] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.059Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"79735f2584ff7ff4e7234495","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-79735f2584ff7ff4e7234495: start","job_status":"start","queue_duration_s":1.32322,"scheduling_latency_s":1.323238}1521gitlab # [ 315.700724] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.073Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"79735f2584ff7ff4e7234495","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-79735f2584ff7ff4e7234495: done: 0.014754 sec","job_status":"done","queue_duration_s":1.32322,"scheduling_latency_s":1.323238,"redis_calls":13,"redis_duration_s":0.001425,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000901,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01037,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014754,"completed_at":"2026-08-16T17:06:05.073Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1522gitlab # [ 315.739933] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.074Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ae7d7608fecbdf650691ed64","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ae7d7608fecbdf650691ed64: start","job_status":"start","queue_duration_s":1.339048,"scheduling_latency_s":1.339065}1523gitlab # [ 315.753208] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.089Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ae7d7608fecbdf650691ed64","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ae7d7608fecbdf650691ed64: done: 0.014687 sec","job_status":"done","queue_duration_s":1.339048,"scheduling_latency_s":1.339065,"redis_calls":13,"redis_duration_s":0.001425,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000915,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010314,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014687,"completed_at":"2026-08-16T17:06:05.089Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1524gitlab # [ 315.793168] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.090Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ee6d4e9c1854a2b53904bdf","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ee6d4e9c1854a2b53904bdf: start","job_status":"start","queue_duration_s":1.354836,"scheduling_latency_s":1.354854}1525gitlab # [ 315.805657] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.105Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ee6d4e9c1854a2b53904bdf","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ee6d4e9c1854a2b53904bdf: done: 0.014572 sec","job_status":"done","queue_duration_s":1.354836,"scheduling_latency_s":1.354854,"redis_calls":13,"redis_duration_s":0.001388,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000872,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009682,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014572,"completed_at":"2026-08-16T17:06:05.105Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1526gitlab # [ 315.844988] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.106Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c3c74150f73e2d463e8c511","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c3c74150f73e2d463e8c511: start","job_status":"start","queue_duration_s":1.370766,"scheduling_latency_s":1.370784}1527gitlab # [ 315.857441] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.121Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c3c74150f73e2d463e8c511","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c3c74150f73e2d463e8c511: done: 0.014742 sec","job_status":"done","queue_duration_s":1.370766,"scheduling_latency_s":1.370784,"redis_calls":13,"redis_duration_s":0.001414,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000894,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010217,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014742,"completed_at":"2026-08-16T17:06:05.121Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1528gitlab # [ 315.896370] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.122Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"60f6f03661cf14c5f796dacf","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-60f6f03661cf14c5f796dacf: start","job_status":"start","queue_duration_s":1.386693,"scheduling_latency_s":1.386712}1529gitlab # [ 315.908744] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.137Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"60f6f03661cf14c5f796dacf","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-60f6f03661cf14c5f796dacf: done: 0.014601 sec","job_status":"done","queue_duration_s":1.386693,"scheduling_latency_s":1.386712,"redis_calls":13,"redis_duration_s":0.001477,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000964,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010247,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014601,"completed_at":"2026-08-16T17:06:05.137Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1530gitlab # [ 315.948774] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.138Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94e75861b1d90b6eb6454d45","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94e75861b1d90b6eb6454d45: start","job_status":"start","queue_duration_s":1.402357,"scheduling_latency_s":1.402375}1531gitlab # [ 315.960961] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.152Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94e75861b1d90b6eb6454d45","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94e75861b1d90b6eb6454d45: done: 0.014362 sec","job_status":"done","queue_duration_s":1.402357,"scheduling_latency_s":1.402375,"redis_calls":13,"redis_duration_s":0.001424,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000919,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010077,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014362,"completed_at":"2026-08-16T17:06:05.152Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1532gitlab # [ 316.000106] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.153Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6422890dd3db4ba4be086538","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6422890dd3db4ba4be086538: start","job_status":"start","queue_duration_s":1.417776,"scheduling_latency_s":1.417794}1533gitlab # [ 316.012472] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.168Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6422890dd3db4ba4be086538","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6422890dd3db4ba4be086538: done: 0.014682 sec","job_status":"done","queue_duration_s":1.417776,"scheduling_latency_s":1.417794,"redis_calls":13,"redis_duration_s":0.001394,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000497,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000897,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009736,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014682,"completed_at":"2026-08-16T17:06:05.168Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1534gitlab # [ 316.051481] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.169Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9daf675b52d7a7901105eccc","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9daf675b52d7a7901105eccc: start","job_status":"start","queue_duration_s":1.433581,"scheduling_latency_s":1.433599}1535gitlab # [ 316.064089] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.184Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9daf675b52d7a7901105eccc","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9daf675b52d7a7901105eccc: done: 0.014797 sec","job_status":"done","queue_duration_s":1.433581,"scheduling_latency_s":1.433599,"redis_calls":13,"redis_duration_s":0.0015630000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000564,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000999,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010344,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014797,"completed_at":"2026-08-16T17:06:05.184Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1536gitlab # [ 316.103295] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.185Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea6d5e481347d060df764e7c","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea6d5e481347d060df764e7c: start","job_status":"start","queue_duration_s":1.449465,"scheduling_latency_s":1.449482}1537gitlab # [ 316.115934] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.199Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea6d5e481347d060df764e7c","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea6d5e481347d060df764e7c: done: 0.014515 sec","job_status":"done","queue_duration_s":1.449465,"scheduling_latency_s":1.449482,"redis_calls":13,"redis_duration_s":0.001424,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000907,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010163,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014515,"completed_at":"2026-08-16T17:06:05.199Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1538gitlab # [ 316.156354] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.200Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de0bec81bddc59476acdfe54","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de0bec81bddc59476acdfe54: start","job_status":"start","queue_duration_s":1.465064,"scheduling_latency_s":1.465083}1539gitlab # [ 316.168354] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.215Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de0bec81bddc59476acdfe54","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de0bec81bddc59476acdfe54: done: 0.014987 sec","job_status":"done","queue_duration_s":1.465064,"scheduling_latency_s":1.465083,"redis_calls":13,"redis_duration_s":0.001692,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001157,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010388,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014987,"completed_at":"2026-08-16T17:06:05.215Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1540gitlab # [ 316.207574] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.217Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"add8e9618ce0e63db22ff3c3","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-add8e9618ce0e63db22ff3c3: start","job_status":"start","queue_duration_s":1.481224,"scheduling_latency_s":1.481242}1541gitlab # [ 316.220166] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.233Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"add8e9618ce0e63db22ff3c3","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-add8e9618ce0e63db22ff3c3: done: 0.015956 sec","job_status":"done","queue_duration_s":1.481224,"scheduling_latency_s":1.481242,"redis_calls":13,"redis_duration_s":0.0015660000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000602,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000964,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01082,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015956,"completed_at":"2026-08-16T17:06:05.233Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1542gitlab # [ 316.259604] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.234Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf6402e7a214920149b60312","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf6402e7a214920149b60312: start","job_status":"start","queue_duration_s":1.498265,"scheduling_latency_s":1.498282}1543gitlab # [ 316.272100] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.250Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf6402e7a214920149b60312","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf6402e7a214920149b60312: done: 0.015881 sec","job_status":"done","queue_duration_s":1.498265,"scheduling_latency_s":1.498282,"redis_calls":13,"redis_duration_s":0.001777,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000556,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001221,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011271,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015881,"completed_at":"2026-08-16T17:06:05.249Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1544gitlab # [ 316.311153] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.251Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b3332e2ce4fdc7cd9628cca4","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b3332e2ce4fdc7cd9628cca4: start","job_status":"start","queue_duration_s":1.515238,"scheduling_latency_s":1.515256}1545gitlab # [ 316.324247] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.265Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b3332e2ce4fdc7cd9628cca4","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b3332e2ce4fdc7cd9628cca4: done: 0.014345 sec","job_status":"done","queue_duration_s":1.515238,"scheduling_latency_s":1.515256,"redis_calls":13,"redis_duration_s":0.0014,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00089,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009764,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014345,"completed_at":"2026-08-16T17:06:05.265Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1546gitlab # [ 316.365273] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.266Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a0964fa7777b3c6ad9ad5e72","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a0964fa7777b3c6ad9ad5e72: start","job_status":"start","queue_duration_s":1.53065,"scheduling_latency_s":1.530666}1547gitlab # [ 316.377646] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.281Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a0964fa7777b3c6ad9ad5e72","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a0964fa7777b3c6ad9ad5e72: done: 0.014608 sec","job_status":"done","queue_duration_s":1.53065,"scheduling_latency_s":1.530666,"redis_calls":13,"redis_duration_s":0.001564,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000567,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000997,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009846,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014608,"completed_at":"2026-08-16T17:06:05.281Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1548gitlab # [ 316.416116] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.282Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af8d5982890d412ffd081998","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af8d5982890d412ffd081998: start","job_status":"start","queue_duration_s":1.546693,"scheduling_latency_s":1.546711}1549gitlab # [ 316.428149] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.299Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af8d5982890d412ffd081998","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af8d5982890d412ffd081998: done: 0.016496 sec","job_status":"done","queue_duration_s":1.546693,"scheduling_latency_s":1.546711,"redis_calls":13,"redis_duration_s":0.00147,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000946,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010289,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016496,"completed_at":"2026-08-16T17:06:05.299Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1550gitlab # [ 316.467120] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.300Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6a2188062375a41fcdcf3166","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6a2188062375a41fcdcf3166: start","job_status":"start","queue_duration_s":1.564245,"scheduling_latency_s":1.564263}1551gitlab # [ 316.479748] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.314Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6a2188062375a41fcdcf3166","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6a2188062375a41fcdcf3166: done: 0.01464 sec","job_status":"done","queue_duration_s":1.564245,"scheduling_latency_s":1.564263,"redis_calls":13,"redis_duration_s":0.0016120000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000691,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000921,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010111,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01464,"completed_at":"2026-08-16T17:06:05.314Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1552gitlab # [ 316.518816] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.315Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9615ec12cd235b22d96519c4","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9615ec12cd235b22d96519c4: start","job_status":"start","queue_duration_s":1.57995,"scheduling_latency_s":1.579968}1553gitlab # [ 316.530942] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.330Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9615ec12cd235b22d96519c4","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9615ec12cd235b22d96519c4: done: 0.014574 sec","job_status":"done","queue_duration_s":1.57995,"scheduling_latency_s":1.579968,"redis_calls":13,"redis_duration_s":0.001435,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000917,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010229,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014574,"completed_at":"2026-08-16T17:06:05.330Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1554gitlab # [ 316.570714] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.331Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"051b68bfb8e242db89e44a80","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-051b68bfb8e242db89e44a80: start","job_status":"start","queue_duration_s":1.595573,"scheduling_latency_s":1.59559}1555gitlab # [ 316.583108] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.346Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"051b68bfb8e242db89e44a80","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-051b68bfb8e242db89e44a80: done: 0.014547 sec","job_status":"done","queue_duration_s":1.595573,"scheduling_latency_s":1.59559,"redis_calls":13,"redis_duration_s":0.00139,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00089,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009889,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014547,"completed_at":"2026-08-16T17:06:05.345Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1556gitlab # [ 316.623046] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.347Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d865e21ac3cf257e7e5b089","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d865e21ac3cf257e7e5b089: start","job_status":"start","queue_duration_s":1.611251,"scheduling_latency_s":1.611268}1557gitlab # [ 316.635565] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.361Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d865e21ac3cf257e7e5b089","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d865e21ac3cf257e7e5b089: done: 0.014482 sec","job_status":"done","queue_duration_s":1.611251,"scheduling_latency_s":1.611268,"redis_calls":13,"redis_duration_s":0.0014169999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000908,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010135,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014482,"completed_at":"2026-08-16T17:06:05.361Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1558gitlab # [ 316.674674] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.362Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d737941b31d0d8a94fe93ac4","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d737941b31d0d8a94fe93ac4: start","job_status":"start","queue_duration_s":1.626842,"scheduling_latency_s":1.626859}1559gitlab # [ 316.686992] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.377Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d737941b31d0d8a94fe93ac4","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d737941b31d0d8a94fe93ac4: done: 0.014424 sec","job_status":"done","queue_duration_s":1.626842,"scheduling_latency_s":1.626859,"redis_calls":13,"redis_duration_s":0.001406,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000502,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000904,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01002,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014424,"completed_at":"2026-08-16T17:06:05.377Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1560gitlab # [ 329.469799] postgres[3394]: [3394] ERROR: relation "table_without_models" does not exist1561gitlab # [ 329.470315] postgres[3394]: [3394] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1562gitlab # [ 335.274017] runuser[3063]: pam_unix(runuser:session): session closed for user gitlab1563gitlab # [ 335.275660] setup-gitlab-start[3033]: + systemctl restart gitlab-sidekiq.service1564gitlab # [ 335.314879] systemd[1]: Stopping gitlab-sidekiq.service...1565gitlab # [ 335.320228] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:25.985Z","message":"Shutting down"}1566gitlab # [ 335.322012] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:25.987Z","message":"Scheduler exiting..."}1567gitlab # [ 335.323786] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:25.988Z","message":"Terminating quiet threads for default capsule"}1568gitlab # [ 335.326028] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:25.988Z","message":"Scheduler exiting..."}1569gitlab # [ 335.824965] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:26.490Z","message":"Pausing to allow jobs to finish..."}1570gitlab # [ 340.335017] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:30.999Z","message":"Bye!"}1571gitlab # [ 341.310742] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:31.976Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":2139,"worker_id":"sidekiq_0","memwd_rss_bytes":952401920,"retry":0}1572gitlab # [ 342.013472] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1573gitlab # [ 342.013869] systemd[1]: Stopped gitlab-sidekiq.service.1574gitlab # [ 342.014146] systemd[1]: gitlab-sidekiq.service: Consumed 1min 52.795s CPU time over 3min 22.929s wall clock time, 947.3M memory peak, 4.5M read from disk.1575gitlab # [ 342.027686] systemd[1]: Started gitlab-sidekiq.service.1576gitlab # [ 342.032266] setup-gitlab-start[3033]: + mkdir -p /var/lib/secrets1577gitlab # [ 342.036719] setup-gitlab-start[3033]: + echo nixbot-test-token-of-20-chars1578gitlab # [ 342.039599] setup-gitlab-start[3033]: + chmod 644 /var/lib/secrets/gitlab-token1579gitlab # [ 342.042753] setup-gitlab-start[3033]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1580gitlab # [ 344.348151] gitaly[923]: time="2026-08-16T17:06:35.012Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M05RM44ZGEG0WV94ADF802CD error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:06:44.000" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:35.011" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1581gitlab # [ 344.378738] gitaly[923]: time="2026-08-16T17:06:35.012Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RM44ZGEG0WV94ADF802CD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:06:44.000" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:35.011" grpc.time_ms=0.632 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1582gitlab # [ 344.766018] gitaly[923]: time="2026-08-16T17:06:35.431Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M05RM44ZGEG0WV94ADF802CD error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:06:45.010" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:35.431" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1583gitlab # [ 344.826187] gitaly[923]: time="2026-08-16T17:06:35.431Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RM44ZGEG0WV94ADF802CD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:06:45.010" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:35.431" grpc.time_ms=0.631 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1584gitlab # [ 344.908254] gitaly[923]: time="2026-08-16T17:06:35.574Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05RM44ZGEG0WV94ADF802CD diskcache=416ad49d-3263-40d1-a8ae-f90f72d7513a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-16T17:06:45.085" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:35.505" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1585gitlab # [ 344.939758] gitaly[923]: time="2026-08-16T17:06:35.574Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=37 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1439 command.oublock=32 command.real_time_ms=43 command.spawn_token_fork_ms=5 command.system_time_ms=31 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M05RM44ZGEG0WV94ADF802CD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-16T17:06:45.085" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:35.505" grpc.time_ms=68.64 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1586gitlab # [ 344.972295] gitaly[923]: time="2026-08-16T17:06:35.616Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M05RM44ZGEG0WV94ADF802CD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:06:45.194" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:35.615" pid=923 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1587gitlab # [ 344.990086] gitaly[923]: time="2026-08-16T17:06:35.617Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RM44ZGEG0WV94ADF802CD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:06:45.194" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:35.615" grpc.time_ms=1.266 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1588gitlab # [ 345.005076] gitaly[923]: time="2026-08-16T17:06:35.650Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M05RM44ZGEG0WV94ADF802CD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T17:06:45.212" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:35.633" grpc.time_ms=16.523 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1589gitlab # [ 345.159262] gitaly[923]: time="2026-08-16T17:06:35.825Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M05RM44ZGEG0WV94ADF802CD error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:06:45.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:35.824" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1590gitlab # [ 345.190971] gitaly[923]: time="2026-08-16T17:06:35.825Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RM44ZGEG0WV94ADF802CD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:06:45.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:35.824" grpc.time_ms=0.599 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1591gitlab # [ 345.221970] gitaly[923]: time="2026-08-16T17:06:35.868Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05RM44ZGEG0WV94ADF802CD diskcache=f6d3fa46-96a8-4eb5-aeee-6483d7c01e72 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-16T17:06:45.007" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:35.828" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1592gitlab # [ 345.242577] gitaly[923]: time="2026-08-16T17:06:35.868Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1440 command.oublock=32 command.real_time_ms=18 command.spawn_token_fork_ms=5 command.system_time_ms=9 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M05RM44ZGEG0WV94ADF802CD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-16T17:06:45.007" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:35.828" grpc.time_ms=39.687 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1593gitlab # [ 345.262884] gitaly[923]: time="2026-08-16T17:06:35.888Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M05RM44ZGEG0WV94ADF802CD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:06:45.066" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:35.887" pid=923 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1594gitlab # [ 345.276472] gitaly[923]: time="2026-08-16T17:06:35.889Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RM44ZGEG0WV94ADF802CD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:06:45.066" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:35.887" grpc.time_ms=1.367 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1595gitlab # [ 345.288646] gitaly[923]: time="2026-08-16T17:06:35.906Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05RM44ZGEG0WV94ADF802CD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T17:06:45.075" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:35.896" grpc.time_ms=10.254 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1596gitlab # [ 345.329665] gitaly[923]: time="2026-08-16T17:06:35.995Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RM44ZGEG0WV94ADF802CD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:06:45.174" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:35.994" grpc.time_ms=0.617 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1597gitlab # [ 345.360217] gitaly[923]: time="2026-08-16T17:06:36.025Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RM44ZGEG0WV94ADF802CD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-16T17:06:46.003" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:36.024" grpc.time_ms=0.771 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1598gitlab # [ 347.203154] gitaly[923]: time="2026-08-16T17:06:37.867Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RM44ZGEG0WV94ADF802CD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T17:06:47.029" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:37.849" grpc.time_ms=17.929 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1599gitlab # [ 347.376418] sidekiq-cluster[3473]: {"severity":"INFO","time":"2026-08-16T17:06:38.013Z","message":"Starting cluster with 1 processes"}1600gitlab # [ 347.874601] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:38 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 58031601gitlab # [ 347.881419] setup-gitlab-start[3033]: + mkdir -p /tmp/test-flake1602gitlab # [ 347.884451] setup-gitlab-start[3033]: + cd /tmp/test-flake1603gitlab # [ 347.886730] setup-gitlab-start[3033]: + git init -b master1604gitlab # [ 347.909953] setup-gitlab-start[3538]: Initialized empty Git repository in /tmp/test-flake/.git/1605gitlab # [ 347.913572] setup-gitlab-start[3033]: + git config user.name test1606gitlab # [ 347.916980] setup-gitlab-start[3033]: + git config user.email test@example.com1607gitlab # [ 347.923556] setup-gitlab-start[3033]: + cat1608gitlab # [ 347.928273] setup-gitlab-start[3033]: + git add flake.nix1609gitlab # [ 347.934915] setup-gitlab-start[3033]: + git commit -m 'initial commit'1610gitlab # [ 347.960145] setup-gitlab-start[3543]: [master (root-commit) 3139bc2] initial commit1611gitlab # [ 347.963076] setup-gitlab-start[3543]: 1 file changed, 10 insertions(+)1612gitlab # [ 347.965649] setup-gitlab-start[3543]: create mode 100644 flake.nix1613gitlab # [ 347.967996] setup-gitlab-start[3033]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1614gitlab # [ 347.976360] setup-gitlab-start[3033]: + git push -u origin master1615gitlab # [ 348.103194] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:38 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 811616gitlab # [ 348.327609] gitaly[923]: time="2026-08-16T17:06:38.992Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMA1J8SWFT2GXVY838YFP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:38.975" grpc.time_ms=16.689 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1617gitlab # [ 348.352618] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:39 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 2471618gitlab # [ 349.273854] gitaly[923]: time="2026-08-16T17:06:39.939Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T17:06:49.001" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:39.921" grpc.time_ms=17.912 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1619gitlab # [ 349.336552] gitaly[923]: time="2026-08-16T17:06:40.001Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=302 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-16T17:07:09.089" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-16T17:06:39.990" grpc.time_ms=10.836 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1620gitlab # [ 349.419885] gitaly[923]: time="2026-08-16T17:06:40.085Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF duration_ms=751ns method=POST pid=923 status=200 url="http://unix/api/v4/internal/allowed"1621gitlab # [ 349.501000] gitaly[923]: time="2026-08-16T17:06:40.166Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF duration_ms=79ns method=POST pid=923 status=200 url="http://unix/api/v4/internal/pre_receive"1622gitlab # [ 349.513889] gitaly[923]: time="2026-08-16T17:06:40.167Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5316 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:39.331" grpc.time_ms=835.785 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1623gitlab # [ 349.565229] gitaly[923]: time="2026-08-16T17:06:40.231Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:40.228" grpc.time_ms=2.002 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1624gitlab # [ 349.627829] gitaly[923]: time="2026-08-16T17:06:40.293Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:40.292" grpc.time_ms=1.271 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1625gitlab # [ 349.691884] gitaly[923]: time="2026-08-16T17:06:40.357Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4787 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:40.356" grpc.time_ms=0.866 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1626gitlab # [ 349.872274] gitaly[923]: time="2026-08-16T17:06:40.538Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T17:06:50.099" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:40.520" grpc.time_ms=17.528 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1627gitlab # [ 349.924179] gitaly[923]: time="2026-08-16T17:06:40.590Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1434 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=3 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-16T17:06:50.143" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:40.564" grpc.time_ms=25.498 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1628gitlab # [ 349.963484] gitaly[923]: time="2026-08-16T17:06:40.629Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF duration_ms=218ns method=POST pid=923 status=200 url="http://unix/api/v4/internal/post_receive"1629gitlab # [ 349.970878] gitaly[923]: time="2026-08-16T17:06:40.630Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4810 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:40.408" grpc.time_ms=221.082 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1630gitlab # [ 349.992759] gitaly[923]: time="2026-08-16T17:06:40.641Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF diskcache=98f537ca-3f06-4e6b-8cd3-1f70b3c804cb grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:39.200" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1631gitlab # [ 350.012779] systemd[1]: Finished setup-gitlab.service.1632gitlab # [ 350.014583] gitlab-workhorse[825]: time="2026-08-16T17:06:40Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521633gitlab # [ 350.017814] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:40 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 16031634gitlab # [ 350.021054] setup-gitlab-start[3547]: To http://gitlab/root/test-flake.git1635gitlab # [ 350.022491] setup-gitlab-start[3547]: * [new branch] master -> master1636gitlab # [ 350.023813] setup-gitlab-start[3547]: branch 'master' set up to track 'origin/master'.1637gitlab # [ 350.025435] gitaly[923]: time="2026-08-16T17:06:40.641Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=389 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=847872 command.minflt=13639 command.oublock=32 command.real_time_ms=1431 command.spawn_token_fork_ms=2 command.system_time_ms=232 command.user_time_ms=157 component=gitaly.StreamServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=684 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:39.200" grpc.time_ms=1441.013 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1638gitlab # [ 350.043519] systemd[1]: Starting nixbot CI service...1639gitlab: (finished: waiting for unit setup-gitlab.service, in 350.91 seconds)1640gitlab: waiting for unit nixbot.service1641gitlab # [ 351.381123] nixbot[3635]: {"ts": "2026-08-16T17:06:42.046Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1642gitlab # [ 351.405547] nixbot[3635]: {"ts": "2026-08-16T17:06:42.071Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1643gitlab # [ 351.449429] nixbot[3635]: {"ts": "2026-08-16T17:06:42.115Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1644gitlab # [ 351.458665] nixbot[3635]: {"ts": "2026-08-16T17:06:42.124Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1645gitlab # [ 351.465925] nixbot[3635]: {"ts": "2026-08-16T17:06:42.131Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1646gitlab # [ 351.478372] nixbot[3635]: {"ts": "2026-08-16T17:06:42.144Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1647gitlab # [ 351.491876] nixbot[3635]: {"ts": "2026-08-16T17:06:42.157Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1648gitlab # [ 351.496205] nixbot[3635]: {"ts": "2026-08-16T17:06:42.161Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1649gitlab # [ 351.508157] nixbot[3635]: {"ts": "2026-08-16T17:06:42.173Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1650gitlab # [ 351.515540] nixbot[3635]: {"ts": "2026-08-16T17:06:42.178Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1651gitlab # [ 351.522599] nixbot[3635]: {"ts": "2026-08-16T17:06:42.188Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1652gitlab # [ 351.535375] nixbot[3635]: {"ts": "2026-08-16T17:06:42.201Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1653gitlab # [ 351.541323] nixbot[3635]: {"ts": "2026-08-16T17:06:42.207Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1654gitlab # [ 351.546565] nixbot[3635]: {"ts": "2026-08-16T17:06:42.210Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1655gitlab # [ 351.552352] nixbot[3635]: {"ts": "2026-08-16T17:06:42.218Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1656gitlab # [ 351.557585] nixbot[3635]: {"ts": "2026-08-16T17:06:42.221Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1657gitlab # [ 351.562747] nixbot[3635]: {"ts": "2026-08-16T17:06:42.224Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1658gitlab # [ 351.567790] nixbot[3635]: {"ts": "2026-08-16T17:06:42.227Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1659gitlab # [ 351.572584] nixbot[3635]: {"ts": "2026-08-16T17:06:42.235Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1660gitlab # [ 351.577128] nixbot[3635]: {"ts": "2026-08-16T17:06:42.238Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1661gitlab # [ 351.581553] nixbot[3635]: {"ts": "2026-08-16T17:06:42.241Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1662gitlab # [ 351.585624] nixbot[3635]: {"ts": "2026-08-16T17:06:42.250Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1663gitlab # [ 351.589910] nixbot[3635]: {"ts": "2026-08-16T17:06:42.253Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1664gitlab # [ 351.594208] nixbot[3635]: {"ts": "2026-08-16T17:06:42.257Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1665gitlab # [ 351.598285] nixbot[3635]: {"ts": "2026-08-16T17:06:42.259Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1666gitlab # [ 352.113316] nixbot[3635]: INFO: Started server process [3635]1667gitlab # [ 352.116055] nixbot[3635]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1668gitlab # [ 352.133395] nixbot[3635]: INFO: ::ffff:127.0.0.1:39808 - "GET /health HTTP/1.1" 200 OK1669gitlab # [ 352.143626] systemd[1]: Started nixbot CI service.1670gitlab # [ 352.148724] systemd[1]: Reached target Multi-User System.1671gitlab # [ 352.151302] systemd[1]: Startup finished in 997ms (kernel) + 4.626s (initrd) + 5min 46.527s (userspace) = 5min 52.151s.1672gitlab # [ 352.441206] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:43 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 3061673gitlab # [ 352.449323] nixbot[3635]: {"ts": "2026-08-16T17:06:43.107Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1674gitlab # [ 352.479128] nixbot[3635]: {"ts": "2026-08-16T17:06:43.145Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1675gitlab: (finished: waiting for unit nixbot.service, in 2.14 seconds)1676gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1677gitlab # [ 352.605230] nixbot[3635]: INFO: ::ffff:127.0.0.1:35154 - "GET /health HTTP/1.1" 200 OK1678gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.05 seconds)1679subtest: project discovered and webhook registered1680gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1681gitlab # [ 352.715331] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:43 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 2261682gitlab # [ 352.719265] nixbot[3635]: {"ts": "2026-08-16T17:06:43.384Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1683gitlab # [ 352.723454] nixbot[3635]: {"ts": "2026-08-16T17:06:43.389Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1684gitlab # [ 352.730631] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:43 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 801685gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.12 seconds)1686gitlab # [ 352.978587] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:43 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 2491687gitlab # [ 352.980814] nixbot[3635]: {"ts": "2026-08-16T17:06:43.646Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1688gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1689gitlab # [ 353.964681] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:44 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 1761690gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.23 seconds)1691(finished: subtest: project discovered and webhook registered, in 1.36 seconds)1692subtest: push delivers the webhook1693gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1694gitlab # [ 354.069426] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:44 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 381695gitlab # [ 354.165085] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:44 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 911696gitlab # [ 354.167975] gitaly[923]: time="2026-08-16T17:06:44.830Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05RMFW3RFP6ZJYCH11MKN38 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=246 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:44.819" grpc.time_ms=10.239 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1697gitlab # [ 354.182366] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:44 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 11771698gitlab # [ 354.185328] nixbot[3635]: {"ts": "2026-08-16T17:06:44.845Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1699gitlab # Enumerating objects: 5, done.1700gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1701gitlab # Delta compression using up to 4 threads1702gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1703gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 274 bytes | 91.00 KiB/s, done.1704gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1705gitlab # [ 354.268109] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:44 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 671706gitlab # [ 354.272194] nixbot[3635]: {"ts": "2026-08-16T17:06:44.937Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1707gitlab # [ 354.349012] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:45 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 731708gitlab # [ 354.353393] nixbot[3635]: {"ts": "2026-08-16T17:06:45.016Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1709gitlab # [ 354.448454] gitaly[923]: time="2026-08-16T17:06:45.114Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=10 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMG50G6V7NJJZTHQ9NYPN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-08-16T17:07:15.085" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:45.086" grpc.time_ms=27.025 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1710gitlab # [ 354.489455] gitaly[923]: time="2026-08-16T17:06:45.155Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMG50G6V7NJJZTHQ9NYPN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:15.152" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:45.153" grpc.time_ms=1.221 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1711gitlab # [ 354.514965] gitaly[923]: time="2026-08-16T17:06:45.180Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMG50G6V7NJJZTHQ9NYPN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-16T17:06:55.145" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:45.165" grpc.time_ms=14.61 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1712gitlab # [ 354.553226] gitaly[923]: time="2026-08-16T17:06:45.219Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=7 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-16T17:07:15.009" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-16T17:06:45.209" grpc.time_ms=9.457 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1713gitlab # [ 354.575787] gitaly[923]: time="2026-08-16T17:06:45.232Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M05RMG0NSRS5JN7G076JGYE8 duration_ms=116ns method=POST pid=923 status=200 url="http://unix/api/v4/internal/allowed"1714gitlab # [ 354.608164] gitaly[923]: time="2026-08-16T17:06:45.274Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M05RMG0NSRS5JN7G076JGYE8 duration_ms=41ns method=POST pid=923 status=200 url="http://unix/api/v4/internal/pre_receive"1715gitlab # [ 354.613439] gitaly[923]: time="2026-08-16T17:06:45.274Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5316 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:45.114" grpc.time_ms=159.508 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1716gitlab # [ 354.631479] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:45 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 2551717gitlab # [ 354.635270] nixbot[3635]: {"ts": "2026-08-16T17:06:45.281Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1718gitlab # [ 354.655340] gitaly[923]: time="2026-08-16T17:06:45.321Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:45.320" grpc.time_ms=0.516 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1719gitlab # [ 354.698092] gitaly[923]: time="2026-08-16T17:06:45.364Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:45.361" grpc.time_ms=2.204 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1720gitlab # [ 354.729043] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:45 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1091721gitlab # [ 354.733274] nixbot[3635]: {"ts": "2026-08-16T17:06:45.396Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1722gitlab # [ 354.737693] nixbot[3635]: {"ts": "2026-08-16T17:06:45.400Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1723gitlab # [ 354.754940] gitaly[923]: time="2026-08-16T17:06:45.421Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4787 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:45.419" grpc.time_ms=0.867 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1724gitlab # [ 354.851529] gitaly[923]: time="2026-08-16T17:06:45.517Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMGHYWZGEM8E4NEK5H457 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:45.508" grpc.time_ms=8.672 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc1725gitlab # [ 354.868238] gitaly[923]: time="2026-08-16T17:06:45.519Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M05RMG0NSRS5JN7G076JGYE8 duration_ms=55ns method=POST pid=923 status=200 url="http://unix/api/v4/internal/post_receive"1726gitlab # [ 354.871499] gitaly[923]: time="2026-08-16T17:06:45.519Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4810 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:45.463" grpc.time_ms=56.367 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1727gitlab # To http://gitlab/root/test-flake.git1728gitlab # [ 354.883631] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:45 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 791729gitlab # 3139bc2..4d08eaf [ 354.886439] gitlab-workhorse[825]: time="2026-08-16T17:06:45Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521730gitlab # master -> master[ 354.888660] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:45 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 6561731gitlab # 1732gitlab # [ 354.890762] gitaly[923]: time="2026-08-16T17:06:45.541Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 diskcache=fadb2520-1d93-40e1-81eb-461ce21c7a9e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:45.011" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1733gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.94 seconds)1734gitlab: must succeed: git -C /tmp/test-flake rev-parse master1735gitlab # [ 354.901631] gitaly[923]: time="2026-08-16T17:06:45.541Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=223 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=847872 command.minflt=13664 command.oublock=32 command.real_time_ms=520 command.spawn_token_fork_ms=2 command.system_time_ms=141 command.user_time_ms=82 component=gitaly.StreamServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=606 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:45.011" grpc.time_ms=530.025 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1736gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)1737gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1738gitlab # [ 355.005107] nixbot[3635]: INFO: ::ffff:127.0.0.1:35164 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1739gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.09 seconds)1740gitlab # [ 355.130954] gitaly[923]: time="2026-08-16T17:06:45.795Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMGMGFY0KQCHHFQ9A431V grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:45.780" pid=923 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1741gitlab # [ 355.159562] gitaly[923]: time="2026-08-16T17:06:45.795Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMGMGFY0KQCHHFQ9A431V grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:45.780" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc1742gitlab # [ 355.189267] gitlab-workhorse[825]: time="2026-08-16T17:06:45Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131743gitlab # [ 355.193667] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:45 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 3051744gitlab # [ 355.198256] gitaly[923]: time="2026-08-16T17:06:45.795Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMGMGFY0KQCHHFQ9A431V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:45.780" grpc.time_ms=15.381 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc1745gitlab # [ 355.355222] gitaly[923]: time="2026-08-16T17:06:46.021Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMGY8N8P49KTW0292C1VM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:45.984" pid=923 remote_ip="2001:db8:1::1" request_sha=d630315ceaf951808c1d698a839c7caca868d650 response_bytes=417 span.kind=server system=grpc1746gitlab # [ 355.377162] gitaly[923]: time="2026-08-16T17:06:46.021Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=30 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1131 command.oublock=0 command.real_time_ms=33 command.spawn_token_fork_ms=1 command.system_time_ms=27 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMGY8N8P49KTW0292C1VM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:45.984" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc1747gitlab # [ 355.401846] gitlab-workhorse[825]: time="2026-08-16T17:06:46Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=4171748gitlab # [ 355.405849] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:46 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 417 "" "git/2.55.0" 1901749gitlab # [ 355.409137] gitaly[923]: time="2026-08-16T17:06:46.021Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=30 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1131 command.oublock=0 command.real_time_ms=33 command.spawn_token_fork_ms=1 command.system_time_ms=27 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMGY8N8P49KTW0292C1VM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:45.984" grpc.time_ms=36.88 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc1750gitlab # [ 355.538995] gitaly[923]: time="2026-08-16T17:06:46.204Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05RMH6A2M5QNZKM598N1NN2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:46.186" grpc.time_ms=17.874 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc1751gitlab # [ 355.576244] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:46 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1161752gitlab # [ 355.665361] gitaly[923]: time="2026-08-16T17:06:46.331Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMHA1C6RT8WJEEK9BXM38 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:46.312" pid=923 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1753gitlab # [ 355.694842] gitaly[923]: time="2026-08-16T17:06:46.331Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMHA1C6RT8WJEEK9BXM38 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:46.312" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc1754gitlab # [ 355.720817] gitlab-workhorse[825]: time="2026-08-16T17:06:46Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671755gitlab # [ 355.723655] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:46 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1221756gitlab # [ 355.726824] gitaly[923]: time="2026-08-16T17:06:46.331Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMHA1C6RT8WJEEK9BXM38 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:46.312" grpc.time_ms=19.061 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc1757gitlab # [ 355.858350] gitaly[923]: time="2026-08-16T17:06:46.524Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05RMHG3G1A9J2Z6HX9K6EKY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:46.506" grpc.time_ms=17.952 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc1758gitlab # [ 355.896463] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:46 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1221759gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1760gitlab # [ 356.010799] gitaly[923]: time="2026-08-16T17:06:46.676Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMHM1M2QNNJQNKXP0V5PX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:46.644" pid=923 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1761gitlab # [ 356.044991] gitaly[923]: time="2026-08-16T17:06:46.676Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=26 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1103 command.oublock=0 command.real_time_ms=28 command.spawn_token_fork_ms=1 command.system_time_ms=23 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMHM1M2QNNJQNKXP0V5PX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:46.644" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc1762gitlab # [ 356.078146] gitlab-workhorse[825]: time="2026-08-16T17:06:46Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091763gitlab # [ 356.082640] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:46 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 1481764gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.09 seconds)1765gitlab # [ 356.086673] gitaly[923]: time="2026-08-16T17:06:46.677Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=26 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1103 command.oublock=0 command.real_time_ms=28 command.spawn_token_fork_ms=1 command.system_time_ms=23 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMHM1M2QNNJQNKXP0V5PX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:46.644" grpc.time_ms=32.284 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc1766gitlab # [ 356.117480] nixbot[3635]: INFO: ::ffff:127.0.0.1:35172 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1767gitlab # [ 356.204333] gitaly[923]: time="2026-08-16T17:06:46.869Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMHTPMK938PQEX88HYGRB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:16.667" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:46.867" grpc.time_ms=1.146 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1768gitlab # [ 356.312332] gitaly[923]: time="2026-08-16T17:06:46.978Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=590 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMHTPMK938PQEX88HYGRB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-16T17:07:16.057" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:46.958" grpc.time_ms=19.764 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1769gitlab # [ 356.358628] gitaly[923]: time="2026-08-16T17:06:47.024Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=6 command.system_time_ms=8 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05RMHTPMK938PQEX88HYGRB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:06:57.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:47.008" grpc.time_ms=16.198 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1770gitlab # [ 356.394633] gitaly[923]: time="2026-08-16T17:06:47.060Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05RMHTPMK938PQEX88HYGRB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:06:57.042" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:47.043" grpc.time_ms=17.169 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1771gitlab # [ 356.531957] gitaly[923]: time="2026-08-16T17:06:47.197Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMHTPMK938PQEX88HYGRB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-16T17:06:57.196" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:47.197" grpc.time_ms=0.645 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1772gitlab # [ 356.598591] gitaly[923]: time="2026-08-16T17:06:47.264Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMHTPMK938PQEX88HYGRB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-16T17:06:57.245" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:47.246" grpc.time_ms=17.763 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1773gitlab # [ 356.671556] gitaly[923]: time="2026-08-16T17:06:47.337Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMHTPMK938PQEX88HYGRB grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:47.336" grpc.time_ms=0.994 pid=923 span.kind=server system=grpc1774gitlab # [ 356.755786] gitaly[923]: time="2026-08-16T17:06:47.421Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMHTPMK938PQEX88HYGRB grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4156 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:47.420" grpc.time_ms=0.773 pid=923 span.kind=server system=grpc1775gitlab # [ 356.785323] gitaly[923]: time="2026-08-16T17:06:47.436Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMHTPMK938PQEX88HYGRB diskcache=b0d93ac1-a42c-4d4b-8990-0fa2b77b2e8f grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T17:06:57.268" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:47.269" pid=923 ref=refs/keep-around/3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 remote_ip="2001:db8:1::1" revision=3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 span.kind=server system=grpc username=root1776gitlab # [ 356.810891] gitaly[923]: time="2026-08-16T17:06:47.436Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=140 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5529 command.oublock=8 command.real_time_ms=159 command.spawn_token_fork_ms=2 command.system_time_ms=88 command.user_time_ms=52 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMHTPMK938PQEX88HYGRB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T17:06:57.268" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:47.269" grpc.time_ms=166.877 pid=923 ref=refs/keep-around/3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 remote_ip="2001:db8:1::1" revision=3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 span.kind=server system=grpc username=root1777gitlab # [ 356.835366] gitaly[923]: time="2026-08-16T17:06:47.443Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMHTPMK938PQEX88HYGRB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:17.242" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:47.442" grpc.time_ms=0.794 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1778gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1779gitlab # [ 357.134332] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:47 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 10561780gitlab # [ 357.143473] nixbot[3635]: {"ts": "2026-08-16T17:06:47.803Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 \"HTTP/1.1 201 Created\""}1781gitlab # [ 357.158245] nixbot[3635]: {"ts": "2026-08-16T17:06:47.824Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-3139bc27e7fc-0"}1782gitlab # [ 357.165574] nixbot[3635]: INFO: ::ffff:127.0.0.1:35188 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1783gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.07 seconds)1784gitlab # [ 357.258299] systemd[1]: Started Nix Daemon.1785gitlab # [ 357.362960] nix-daemon[3858]: accepted connection from pid 3852, user nixbot1786gitlab # [ 357.483965] nix-daemon[3858]: accepted connection from pid 3865, user nixbot1787gitlab # [ 357.508224] nixbot[3635]: {"ts": "2026-08-16T17:06:48.173Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-3139bc27e7fc-0", "argv0": "bwrap"}1788gitlab # [ 357.747393] nix-daemon[3858]: accepted connection from pid 3875, user nixbot1789gitlab # [ 357.830536] nix-daemon[3858]: accepted connection from pid 3885, user nixbot1790gitlab # [ 357.849470] nix-daemon[3858]: accepted connection from pid 3875, user nixbot1791gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1792gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds)1793gitlab # [ 358.225191] nixbot[3635]: INFO: ::ffff:127.0.0.1:35190 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1794gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1795gitlab # [ 359.281818] nixbot[3635]: INFO: ::ffff:127.0.0.1:35204 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1796gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds)1797gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1798gitlab # [ 360.347936] nixbot[3635]: INFO: ::ffff:127.0.0.1:35220 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1799gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds)1800gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1801gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds)1802gitlab # [ 361.402301] nixbot[3635]: INFO: ::ffff:127.0.0.1:48236 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1803gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1804gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds)1805gitlab # [ 362.456079] nixbot[3635]: INFO: ::ffff:127.0.0.1:48242 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1806gitlab # [ 362.516812] gitaly[923]: time="2026-08-16T17:06:53.179Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMR01APR95NWQDF5MJWTW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:23.077" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:53.178" grpc.time_ms=1.401 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1807gitlab # [ 362.590454] gitaly[923]: time="2026-08-16T17:06:53.256Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M05RMR01APR95NWQDF5MJWTW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:07:03.237" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:53.238" grpc.time_ms=18.005 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1808gitlab # [ 362.737081] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:53 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 3431809gitlab # [ 362.745137] nixbot[3635]: {"ts": "2026-08-16T17:06:53.404Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 \"HTTP/1.1 201 Created\""}1810gitlab # [ 362.862670] gitaly[923]: time="2026-08-16T17:06:53.528Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMRB48QR6RHQCR9R7NFTT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:23.526" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:53.527" grpc.time_ms=1.173 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1811gitlab # [ 363.078510] gitaly[923]: time="2026-08-16T17:06:53.744Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M05RMRB48QR6RHQCR9R7NFTT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:07:03.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:53.726" grpc.time_ms=17.655 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1812gitlab # [ 363.246069] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:53 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 4981813gitlab # [ 363.249750] nixbot[3635]: {"ts": "2026-08-16T17:06:53.914Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 \"HTTP/1.1 201 Created\""}1814gitlab # [ 363.382463] gitaly[923]: time="2026-08-16T17:06:54.048Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMRVCXSAADVMHDG8RR9FD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:24.045" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:54.046" grpc.time_ms=1.341 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1815gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1816gitlab # [ 363.453863] gitaly[923]: time="2026-08-16T17:06:54.119Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05RMRVCXSAADVMHDG8RR9FD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:07:04.082" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:54.102" grpc.time_ms=16.842 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1817gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.08 seconds)1818gitlab # [ 363.535828] nixbot[3635]: INFO: ::ffff:127.0.0.1:48252 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1819gitlab # [ 363.571665] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:54 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 3041820gitlab # [ 363.580993] nixbot[3635]: {"ts": "2026-08-16T17:06:54.239Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 \"HTTP/1.1 201 Created\""}1821gitlab # [ 363.736522] nix-daemon[3858]: accepted connection from pid 3933, user nixbot1822gitlab # [ 363.923662] gitaly[923]: time="2026-08-16T17:06:54.587Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMSCJPP2T546T4E1NDF9W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:54.571" grpc.time_ms=15.843 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc1823gitlab # [ 363.964528] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:54 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1061824gitlab # [ 364.101321] gitaly[923]: time="2026-08-16T17:06:54.767Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMSH658F90RTYNQQD2X83 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:54.747" pid=923 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1825gitlab # [ 364.129432] gitaly[923]: time="2026-08-16T17:06:54.767Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMSH658F90RTYNQQD2X83 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:54.747" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc1826gitlab # [ 364.157241] gitlab-workhorse[825]: time="2026-08-16T17:06:54Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671827gitlab # [ 364.160452] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:54 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1371828gitlab # [ 364.163539] gitaly[923]: time="2026-08-16T17:06:54.767Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMSH658F90RTYNQQD2X83 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:54.747" grpc.time_ms=20.142 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc1829gitlab # [ 364.264435] nix-daemon[3858]: accepted connection from pid 3958, user nixbot1830gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1831gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds)1832gitlab # [ 364.596329] nixbot[3635]: INFO: ::ffff:127.0.0.1:48260 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1833gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1834gitlab # [ 365.648599] nixbot[3635]: INFO: ::ffff:127.0.0.1:48266 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1835gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds)1836gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1837gitlab # [ 366.704454] nixbot[3635]: INFO: ::ffff:127.0.0.1:48272 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1838gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds)1839gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1840gitlab # [ 367.760688] nixbot[3635]: INFO: ::ffff:127.0.0.1:48274 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1841gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds)1842gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1843gitlab # [ 368.821867] nixbot[3635]: INFO: ::ffff:127.0.0.1:48286 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1844gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds)1845gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1846gitlab # [ 369.877361] nixbot[3635]: INFO: ::ffff:127.0.0.1:48296 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1847gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds)1848gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1849gitlab # [ 370.931631] nixbot[3635]: INFO: ::ffff:127.0.0.1:54854 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1850gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds)1851gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1852gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds)1853gitlab # [ 371.985783] nixbot[3635]: INFO: ::ffff:127.0.0.1:54862 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1854gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1855gitlab # [ 373.037854] nixbot[3635]: INFO: ::ffff:127.0.0.1:54878 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1856gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds)1857gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1858gitlab # [ 374.092920] nixbot[3635]: INFO: ::ffff:127.0.0.1:54890 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1859gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds)1860gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1861gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds)1862gitlab # [ 375.148716] nixbot[3635]: INFO: ::ffff:127.0.0.1:54902 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1863gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1864gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds)1865gitlab # [ 376.200883] nixbot[3635]: INFO: ::ffff:127.0.0.1:54914 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1866gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1867gitlab # [ 377.251991] nixbot[3635]: INFO: ::ffff:127.0.0.1:54928 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1868gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds)1869gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1870gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds)1871gitlab # [ 378.306191] nixbot[3635]: INFO: ::ffff:127.0.0.1:54936 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1872gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1873gitlab # [ 379.358101] nixbot[3635]: INFO: ::ffff:127.0.0.1:54950 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1874gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds)1875gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1876gitlab # [ 380.412325] nixbot[3635]: INFO: ::ffff:127.0.0.1:54956 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1877gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds)1878gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1879gitlab # [ 381.465843] nixbot[3635]: INFO: ::ffff:127.0.0.1:38920 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1880gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds)1881gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1882gitlab # [ 382.520542] nixbot[3635]: INFO: ::ffff:127.0.0.1:38936 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1883gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds)1884gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1885gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds)1886gitlab # [ 383.574832] nixbot[3635]: INFO: ::ffff:127.0.0.1:38938 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1887gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1888gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds)1889gitlab # [ 384.627699] nixbot[3635]: INFO: ::ffff:127.0.0.1:38944 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1890gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1891gitlab # [ 385.679599] nixbot[3635]: INFO: ::ffff:127.0.0.1:38950 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1892gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds)1893gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1894gitlab # [ 386.734984] nixbot[3635]: INFO: ::ffff:127.0.0.1:38966 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1895gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds)1896gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1897gitlab # [ 387.784441] sidekiq-cluster[3532]: 2026-08-16T17:07:18.449Z pid=3532 tid=yn8 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>3532, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>425975808}1898gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds)1899gitlab # [ 387.788296] nixbot[3635]: INFO: ::ffff:127.0.0.1:38970 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1900gitlab # [ 388.053177] sidekiq-cluster[3532]: W, [2026-08-16T17:07:18.719029 #3532] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1901gitlab # [ 388.187331] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:07:18.853Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1902gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1903gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds)1904gitlab # [ 388.843791] nixbot[3635]: INFO: ::ffff:127.0.0.1:38972 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1905gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1906gitlab # [ 389.896868] nixbot[3635]: INFO: ::ffff:127.0.0.1:38986 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1907gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds)1908gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1909gitlab # [ 390.954557] nixbot[3635]: INFO: ::ffff:127.0.0.1:49832 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1910gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds)1911gitlab # [ 391.151429] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:07:21.816Z","message":"GitLab reliable fetch activated!"}1912gitlab # [ 391.156883] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:07:21.816Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1913gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1914gitlab # [ 392.012268] nixbot[3635]: INFO: ::ffff:127.0.0.1:49836 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1915gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds)1916gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1917gitlab # [ 393.072764] nixbot[3635]: INFO: ::ffff:127.0.0.1:49848 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1918gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds)1919gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1920gitlab # [ 394.133011] nixbot[3635]: INFO: ::ffff:127.0.0.1:49850 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1921gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds)1922gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1923gitlab # [ 395.192631] nixbot[3635]: INFO: ::ffff:127.0.0.1:49856 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1924gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds)1925gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1926gitlab # [ 396.248443] nixbot[3635]: INFO: ::ffff:127.0.0.1:49866 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1927gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds)1928gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1929gitlab # [ 397.302955] nixbot[3635]: INFO: ::ffff:127.0.0.1:49872 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1930gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds)1931gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1932gitlab # [ 398.357480] nixbot[3635]: INFO: ::ffff:127.0.0.1:49884 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1933gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds)1934gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1935gitlab # [ 399.411489] nixbot[3635]: INFO: ::ffff:127.0.0.1:49888 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1936gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds)1937gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1938gitlab # [ 400.465503] nixbot[3635]: INFO: ::ffff:127.0.0.1:49890 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1939gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds)1940gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1941gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds)1942gitlab # [ 401.520210] nixbot[3635]: INFO: ::ffff:127.0.0.1:53202 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1943gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1944gitlab # [ 402.574853] nixbot[3635]: INFO: ::ffff:127.0.0.1:53216 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1945gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds)1946gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1947gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds)1948gitlab # [ 403.629792] nixbot[3635]: INFO: ::ffff:127.0.0.1:53226 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1949gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1950gitlab # [ 404.682760] nixbot[3635]: INFO: ::ffff:127.0.0.1:53238 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1951gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds)1952gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1953gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds)1954gitlab # [ 405.738732] nixbot[3635]: INFO: ::ffff:127.0.0.1:53242 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1955gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1956gitlab # [ 406.792647] nixbot[3635]: INFO: ::ffff:127.0.0.1:53252 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1957gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds)1958gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1959gitlab # [ 407.847680] nixbot[3635]: INFO: ::ffff:127.0.0.1:53258 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1960gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds)1961gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1962gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds)1963gitlab # [ 408.906940] nixbot[3635]: INFO: ::ffff:127.0.0.1:53260 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1964gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1965gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds)1966gitlab # [ 409.962680] nixbot[3635]: INFO: ::ffff:127.0.0.1:53270 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1967gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1968gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds)1969gitlab # [ 411.018029] nixbot[3635]: INFO: ::ffff:127.0.0.1:51670 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1970gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1971gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds)1972gitlab # [ 412.072534] nixbot[3635]: INFO: ::ffff:127.0.0.1:51678 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1973gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1974gitlab # [ 413.126299] nixbot[3635]: INFO: ::ffff:127.0.0.1:51690 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1975gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds)1976gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1977gitlab # [ 414.182991] nixbot[3635]: INFO: ::ffff:127.0.0.1:51692 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1978gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds)1979gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1980gitlab # [ 415.238607] nixbot[3635]: INFO: ::ffff:127.0.0.1:51708 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1981gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds)1982gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1983gitlab # [ 416.294544] nixbot[3635]: INFO: ::ffff:127.0.0.1:51712 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1984gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds)1985gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1986gitlab # [ 417.350796] nixbot[3635]: INFO: ::ffff:127.0.0.1:51720 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1987gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds)1988gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1989gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds)1990gitlab # [ 418.406849] nixbot[3635]: INFO: ::ffff:127.0.0.1:51734 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1991gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1992gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds)1993gitlab # [ 419.458941] nixbot[3635]: INFO: ::ffff:127.0.0.1:51740 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1994gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1995gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds)1996gitlab # [ 420.512623] nixbot[3635]: INFO: ::ffff:127.0.0.1:51756 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK1997gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'1998gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds)1999gitlab # [ 421.569188] nixbot[3635]: INFO: ::ffff:127.0.0.1:35224 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK2000gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'2001gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds)2002gitlab # [ 422.622608] nixbot[3635]: INFO: ::ffff:127.0.0.1:35226 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK2003gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'2004gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds)2005gitlab # [ 423.675605] nixbot[3635]: INFO: ::ffff:127.0.0.1:35232 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK2006gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'2007gitlab # [ 424.726227] nixbot[3635]: INFO: ::ffff:127.0.0.1:35236 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK2008gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds)2009gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'2010gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds)2011gitlab # [ 425.780899] nixbot[3635]: INFO: ::ffff:127.0.0.1:35246 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK2012gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'2013gitlab # [ 426.835009] nixbot[3635]: INFO: ::ffff:127.0.0.1:35248 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK2014gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds)2015gitlab # [ 427.167941] postgres[4157]: [4157] ERROR: relation "table_without_models" does not exist2016gitlab # [ 427.171438] postgres[4157]: [4157] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')2017gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'2018gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds)2019gitlab # [ 427.892844] nixbot[3635]: INFO: ::ffff:127.0.0.1:35260 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK2020gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'2021gitlab # [ 428.947653] nixbot[3635]: INFO: ::ffff:127.0.0.1:35270 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK2022gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds)2023gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'2024gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds)2025gitlab # [ 430.003858] nixbot[3635]: INFO: ::ffff:127.0.0.1:35278 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK2026gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'2027gitlab # [ 431.058675] nixbot[3635]: INFO: ::ffff:127.0.0.1:36324 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK2028gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds)2029gitlab # [ 432.028562] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:02.693Z","message":"Booted Rails 7.2.3.1 application in production environment"}2030gitlab # [ 432.032938] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:02.698Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}2031gitlab # [ 432.039688] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:02.698Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}2032gitlab # [ 432.045454] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:02.699Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}2033gitlab # [ 432.051582] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:02.700Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2034gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'2035gitlab # [ 432.116253] nixbot[3635]: INFO: ::ffff:127.0.0.1:36336 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK2036gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds)2037gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'2038gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds)2039gitlab # [ 433.174225] nixbot[3635]: INFO: ::ffff:127.0.0.1:36352 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK2040gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'2041gitlab # [ 434.227892] nixbot[3635]: INFO: ::ffff:127.0.0.1:36360 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK2042gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds)2043gitlab # [ 434.650220] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:05.314Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"2f7d520b2a1df8d385ad7607","created_at":"2026-08-16T17:06:35.676Z","trace_propagation_headers":{"sentry-trace":"ede8475cee1d43418a1466e04b7c4a4e-a79e43eadbc84f47","baggage":"sentry-trace_id=ede8475cee1d43418a1466e04b7c4a4e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RM44ZGEG0WV94ADF802CD","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:35.746Z","job_size_bytes":2,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-2f7d520b2a1df8d385ad7607: start","job_status":"start","queue_duration_s":89.568674,"scheduling_latency_s":89.56877}2044gitlab # [ 435.047552] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:05.712Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"2f7d520b2a1df8d385ad7607","created_at":"2026-08-16T17:06:35.676Z","trace_propagation_headers":{"sentry-trace":"ede8475cee1d43418a1466e04b7c4a4e-a79e43eadbc84f47","baggage":"sentry-trace_id=ede8475cee1d43418a1466e04b7c4a4e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RM44ZGEG0WV94ADF802CD","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:35.746Z","job_size_bytes":2,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-2f7d520b2a1df8d385ad7607: done: 0.39788 sec","job_status":"done","queue_duration_s":89.568674,"scheduling_latency_s":89.56877,"redis_calls":23,"redis_duration_s":0.011803000000000001,"redis_read_bytes":910,"redis_write_bytes":2540,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.006497,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003174,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002132,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.205134,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.21047876,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.39788,"completed_at":"2026-08-16T17:08:05.712Z","load_balancing_strategy":"primary","db_duration_s":0.11072,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2045gitlab # [ 435.147361] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:05.715Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"08ccf3f9aa2bade07531a358","created_at":"2026-08-16T17:06:35.791Z","trace_propagation_headers":{"sentry-trace":"ede8475cee1d43418a1466e04b7c4a4e-a79e43eadbc84f47","baggage":"sentry-trace_id=ede8475cee1d43418a1466e04b7c4a4e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RM44ZGEG0WV94ADF802CD","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:35.810Z","job_size_bytes":2,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-08ccf3f9aa2bade07531a358: start","job_status":"start","queue_duration_s":89.905136,"scheduling_latency_s":89.905178}2046gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'2047gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.07 seconds)2048gitlab # [ 435.239253] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:05.904Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"08ccf3f9aa2bade07531a358","created_at":"2026-08-16T17:06:35.791Z","trace_propagation_headers":{"sentry-trace":"ede8475cee1d43418a1466e04b7c4a4e-a79e43eadbc84f47","baggage":"sentry-trace_id=ede8475cee1d43418a1466e04b7c4a4e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RM44ZGEG0WV94ADF802CD","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:35.810Z","job_size_bytes":2,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-08ccf3f9aa2bade07531a358: done: 0.189147 sec","job_status":"done","queue_duration_s":89.905136,"scheduling_latency_s":89.905178,"redis_calls":14,"redis_duration_s":0.005105999999999999,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001051,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002466,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001589,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.140395,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.14379352,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.189147,"completed_at":"2026-08-16T17:08:05.904Z","load_balancing_strategy":"primary","db_duration_s":0.036946,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2049gitlab # [ 435.353558] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:05.909Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"ff9f55f3a44f1d32f566c7dc","created_at":"2026-08-16T17:06:37.716Z","trace_propagation_headers":{"sentry-trace":"ede8475cee1d43418a1466e04b7c4a4e-a79e43eadbc84f47","baggage":"sentry-trace_id=ede8475cee1d43418a1466e04b7c4a4e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RM44ZGEG0WV94ADF802CD","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:37.723Z","job_size_bytes":5,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-ff9f55f3a44f1d32f566c7dc: start","job_status":"start","queue_duration_s":88.185721,"scheduling_latency_s":88.185754}2050gitlab # [ 435.378450] nixbot[3635]: INFO: ::ffff:127.0.0.1:36374 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK2051gitlab # [ 435.545338] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:06.210Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"ff9f55f3a44f1d32f566c7dc","created_at":"2026-08-16T17:06:37.716Z","trace_propagation_headers":{"sentry-trace":"ede8475cee1d43418a1466e04b7c4a4e-a79e43eadbc84f47","baggage":"sentry-trace_id=ede8475cee1d43418a1466e04b7c4a4e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RM44ZGEG0WV94ADF802CD","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:37.723Z","job_size_bytes":5,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-ff9f55f3a44f1d32f566c7dc: done: 0.301151 sec","job_status":"done","queue_duration_s":88.185721,"scheduling_latency_s":88.185754,"redis_calls":12,"redis_duration_s":0.007052,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.003131,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002917,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001004,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.027,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.240058,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00046012,"duration_s":0.301151,"completed_at":"2026-08-16T17:08:06.210Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.046051,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2052gitlab # [ 435.654162] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:06.212Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"d061f3115f325e2bd644cee6","created_at":"2026-08-16T17:06:37.769Z","trace_propagation_headers":{"sentry-trace":"ede8475cee1d43418a1466e04b7c4a4e-a79e43eadbc84f47","baggage":"sentry-trace_id=ede8475cee1d43418a1466e04b7c4a4e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RM44ZGEG0WV94ADF802CD","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:37.776Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-d061f3115f325e2bd644cee6: start","job_status":"start","queue_duration_s":88.436605,"scheduling_latency_s":88.436628}2053gitlab # [ 435.847082] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:06.512Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"d061f3115f325e2bd644cee6","created_at":"2026-08-16T17:06:37.769Z","trace_propagation_headers":{"sentry-trace":"ede8475cee1d43418a1466e04b7c4a4e-a79e43eadbc84f47","baggage":"sentry-trace_id=ede8475cee1d43418a1466e04b7c4a4e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RM44ZGEG0WV94ADF802CD","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:37.776Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-d061f3115f325e2bd644cee6: done: 0.299625 sec","job_status":"done","queue_duration_s":88.436605,"scheduling_latency_s":88.436628,"redis_calls":11,"redis_duration_s":0.003503,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00088,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001985,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000638,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.042,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.252,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.252,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.04,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.192182,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00063178,"duration_s":0.299625,"completed_at":"2026-08-16T17:08:06.512Z","load_balancing_strategy":"primary","db_duration_s":0.111223,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2054gitlab # [ 435.945778] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:06.515Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"bcb77ad627410589c14ac2c1","created_at":"2026-08-16T17:06:37.780Z","trace_propagation_headers":{"sentry-trace":"ede8475cee1d43418a1466e04b7c4a4e-a79e43eadbc84f47","baggage":"sentry-trace_id=ede8475cee1d43418a1466e04b7c4a4e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RM44ZGEG0WV94ADF802CD","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:37.786Z","job_size_bytes":89,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-bcb77ad627410589c14ac2c1: start","job_status":"start","queue_duration_s":88.728758,"scheduling_latency_s":88.72879}2055gitlab # [ 435.995242] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:06.567Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"bcb77ad627410589c14ac2c1","created_at":"2026-08-16T17:06:37.780Z","trace_propagation_headers":{"sentry-trace":"ede8475cee1d43418a1466e04b7c4a4e-a79e43eadbc84f47","baggage":"sentry-trace_id=ede8475cee1d43418a1466e04b7c4a4e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RM44ZGEG0WV94ADF802CD","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:37.786Z","job_size_bytes":89,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-bcb77ad627410589c14ac2c1: done: 0.052963 sec","job_status":"done","queue_duration_s":88.728758,"scheduling_latency_s":88.72879,"redis_calls":11,"redis_duration_s":0.00357,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000918,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002012,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00064,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034121,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00069134,"duration_s":0.052963,"completed_at":"2026-08-16T17:08:06.567Z","load_balancing_strategy":"primary","db_duration_s":0.00912,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2056gitlab # [ 436.070944] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:06.570Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"5db0d0603fe204acefee48ac","created_at":"2026-08-16T17:06:40.483Z","trace_propagation_headers":{"sentry-trace":"e4a4ed6dce5a401b86f7038d15d31640-e5c6c6538c1b4137","baggage":"sentry-trace_id=e4a4ed6dce5a401b86f7038d15d31640,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RMA9YKSWZEKT0TS5Z9HSF","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:40.492Z","job_size_bytes":185,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-5db0d0603fe204acefee48ac: start","job_status":"start","queue_duration_s":86.077733,"scheduling_latency_s":86.077758}2057gitlab # [ 436.094263] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:06.591Z","message":"changes: \"0000000000000000000000000000000000000000 3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 refs/heads/master\\n\""}2058gitlab # [ 436.098358] gitaly[923]: time="2026-08-16T17:08:06.642Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:08:16.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:06.627" grpc.time_ms=13.968 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2059gitlab # [ 436.114681] gitaly[923]: time="2026-08-16T17:08:06.662Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T17:08:16.027" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:08:06.648" grpc.time_ms=14.142 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2060gitlab # [ 436.129973] gitaly[923]: time="2026-08-16T17:08:06.733Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=3 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-16T17:08:16.099" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:06.719" grpc.time_ms=13.059 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2061gitlab # [ 436.144088] gitaly[923]: time="2026-08-16T17:08:06.803Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3937 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:08:06.802" grpc.time_ms=0.749 pid=923 span.kind=server system=grpc2062gitlab # [ 436.181240] gitaly[923]: time="2026-08-16T17:08:06.847Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3939 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:08:06.846" grpc.time_ms=0.459 pid=923 span.kind=server system=grpc2063gitlab # [ 436.200683] gitaly[923]: time="2026-08-16T17:08:06.859Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF diskcache=ff3c8150-ae81-4a5f-809c-c3acdb8b5be9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T17:08:16.123" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:08:06.744" pid=923 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2064gitlab # [ 436.217781] gitaly[923]: time="2026-08-16T17:08:06.859Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=123 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5192 command.oublock=8 command.real_time_ms=109 command.spawn_token_fork_ms=1 command.system_time_ms=71 command.user_time_ms=52 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T17:08:16.123" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:08:06.744" grpc.time_ms=115.53 pid=923 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2065gitlab # [ 436.236106] gitaly[923]: time="2026-08-16T17:08:06.888Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:08:16.267" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:08:06.888" grpc.time_ms=0.278 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2066gitlab # [ 436.253322] gitaly[923]: time="2026-08-16T17:08:06.919Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=858 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-16T17:08:16.275" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:06.896" grpc.time_ms=22.915 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2067gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'2068gitlab # [ 436.363320] nixbot[3635]: INFO: ::ffff:127.0.0.1:36382 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK2069gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.07 seconds)2070gitlab # [ 436.426959] gitaly[923]: time="2026-08-16T17:08:07.092Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=312 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-08-16T17:08:37.079" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:07.079" grpc.time_ms=12.743 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2071gitlab # [ 436.492576] gitaly[923]: time="2026-08-16T17:08:07.158Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-16T17:08:17.006" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:08:07.157" grpc.time_ms=0.579 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2072gitlab # [ 436.523144] gitaly[923]: time="2026-08-16T17:08:07.175Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=316 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-16T17:08:17.012" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-08-16T17:08:07.162" grpc.time_ms=12.318 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2073gitlab # [ 436.554530] gitaly[923]: time="2026-08-16T17:08:07.220Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:08:17.051" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:07.202" grpc.time_ms=17.924 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2074gitlab # [ 436.583770] gitaly[923]: time="2026-08-16T17:08:07.249Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:08:17.080" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:07.231" grpc.time_ms=18.588 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2075gitlab # [ 436.638052] gitaly[923]: time="2026-08-16T17:08:07.304Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=21 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=882 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=3 command.system_time_ms=14 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-16T17:08:37.273" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:07.274" grpc.time_ms=29.731 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2076gitlab # [ 437.228425] gitaly[923]: time="2026-08-16T17:08:07.893Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-16T17:08:17.270" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:07.890" grpc.time_ms=2.294 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2077gitlab # [ 437.268283] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:07.932Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"5db0d0603fe204acefee48ac","created_at":"2026-08-16T17:06:40.483Z","trace_propagation_headers":{"sentry-trace":"e4a4ed6dce5a401b86f7038d15d31640-e5c6c6538c1b4137","baggage":"sentry-trace_id=e4a4ed6dce5a401b86f7038d15d31640,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RMA9YKSWZEKT0TS5Z9HSF","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:40.492Z","job_size_bytes":185,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-5db0d0603fe204acefee48ac: done: 1.362508 sec","job_status":"done","queue_duration_s":86.077733,"scheduling_latency_s":86.077758,"gitaly_calls":13,"gitaly_duration_s":0.329166,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.06320100000000001,"redis_read_bytes":2103,"redis_write_bytes":21751,"redis_cache_calls":15,"redis_cache_duration_s":0.006721,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.008247,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.00242,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7839,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.005788,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.025093,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.014932,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.091,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.316,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.363,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.091,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.883037,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00078666,"exclusive_lock_hold_duration_s":0.036721540000000004,"duration_s":1.362508,"completed_at":"2026-08-16T17:08:07.932Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.157587,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2078gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'2079gitlab # [ 437.371608] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:07.935Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"20c73874d3f015232e5b9502","created_at":"2026-08-16T17:06:45.492Z","trace_propagation_headers":{"sentry-trace":"cf80ac8fe018495f99f53478a2596cb3-46971428077f4598","baggage":"sentry-trace_id=cf80ac8fe018495f99f53478a2596cb3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RMG0NSRS5JN7G076JGYE8","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:45.495Z","job_size_bytes":185,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-20c73874d3f015232e5b9502: start","job_status":"start","queue_duration_s":82.440216,"scheduling_latency_s":82.440242}2080gitlab # [ 437.391576] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:07.948Z","message":"changes: \"3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 refs/heads/master\\n\""}2081gitlab # [ 437.394607] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:08.011Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"dbc348e0de90a1bc2cdbf0aa","created_at":"2026-08-16T17:08:08.008Z","trace_propagation_headers":{"sentry-trace":"cf80ac8fe018495f99f53478a2596cb3-d689edc6a35e40be","baggage":"sentry-trace_id=cf80ac8fe018495f99f53478a2596cb3,sentry-release=Unknown"},"correlation_id":"01M05RMG0NSRS5JN7G076JGYE8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"aa2c62cb516b5227cd68ffe1","job_size_bytes":46,"pid":3532,"job_status":"deduplicated","message":"ProjectCacheWorker JID-dbc348e0de90a1bc2cdbf0aa: deduplicated: until executing","deduplication.type":"until executing"}2082gitlab # [ 437.411823] gitaly[923]: time="2026-08-16T17:08:07.982Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:08:17.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:07.967" grpc.time_ms=14.691 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2083gitlab # [ 437.428049] gitaly[923]: time="2026-08-16T17:08:08.003Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T17:08:17.026" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:08:07.986" grpc.time_ms=16.63 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2084gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.07 seconds)2085gitlab # [ 437.443609] gitaly[923]: time="2026-08-16T17:08:08.055Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-16T17:08:18.007" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:08.037" grpc.time_ms=17.319 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2086gitlab # [ 437.458541] nixbot[3635]: INFO: ::ffff:127.0.0.1:36396 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK2087gitlab # [ 437.460596] gitaly[923]: time="2026-08-16T17:08:08.087Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-08-16T17:08:38.066" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:08.067" grpc.time_ms=19.92 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2088gitlab # [ 437.476830] gitaly[923]: time="2026-08-16T17:08:08.117Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=318 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=4 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-16T17:08:18.074" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-08-16T17:08:08.105" grpc.time_ms=11.979 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2089gitlab # [ 437.490058] gitaly[923]: time="2026-08-16T17:08:08.151Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:08:18.104" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:08.134" grpc.time_ms=16.565 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2090gitlab # [ 437.658061] gitaly[923]: time="2026-08-16T17:08:08.324Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-16T17:08:18.171" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:08.321" grpc.time_ms=2.326 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2091gitlab # [ 437.697627] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:08.362Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"20c73874d3f015232e5b9502","created_at":"2026-08-16T17:06:45.492Z","trace_propagation_headers":{"sentry-trace":"cf80ac8fe018495f99f53478a2596cb3-46971428077f4598","baggage":"sentry-trace_id=cf80ac8fe018495f99f53478a2596cb3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RMG0NSRS5JN7G076JGYE8","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:45.495Z","job_size_bytes":185,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-20c73874d3f015232e5b9502: done: 0.426929 sec","job_status":"done","queue_duration_s":82.440216,"scheduling_latency_s":82.440242,"gitaly_calls":7,"gitaly_duration_s":0.125587,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.0398,"redis_read_bytes":500,"redis_write_bytes":11943,"redis_cache_calls":9,"redis_cache_duration_s":0.004318,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001945,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5720,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.006229,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.013534,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.013774,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.04,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.044,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.044,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.04,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.253093,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00072622,"exclusive_lock_hold_duration_s":0.02434694,"duration_s":0.426929,"completed_at":"2026-08-16T17:08:08.362Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.041319,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2092gitlab # [ 437.787463] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:08.366Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"73db8523c79b1926b98a1907","created_at":"2026-08-16T17:06:47.458Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-114f4c9a19fb4ec8","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:47.475Z","job_size_bytes":65,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-73db8523c79b1926b98a1907: start","job_status":"start","queue_duration_s":80.890919,"scheduling_latency_s":80.890969}2093gitlab # [ 437.897870] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:08.562Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"73db8523c79b1926b98a1907","created_at":"2026-08-16T17:06:47.458Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-114f4c9a19fb4ec8","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:47.475Z","job_size_bytes":65,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-73db8523c79b1926b98a1907: done: 0.196179 sec","job_status":"done","queue_duration_s":80.890919,"scheduling_latency_s":80.890969,"redis_calls":16,"redis_duration_s":0.007585,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.003607,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003009,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000969,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.139779,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00098338,"duration_s":0.196179,"completed_at":"2026-08-16T17:08:08.562Z","load_balancing_strategy":"primary","db_duration_s":0.040779,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2094gitlab # [ 437.995531] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:08.566Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"48e7111def8345383d5ad27e","created_at":"2026-08-16T17:06:47.480Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-114f4c9a19fb4ec8","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:47.492Z","job_size_bytes":65,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-48e7111def8345383d5ad27e: start","job_status":"start","queue_duration_s":81.074408,"scheduling_latency_s":81.074457}2095gitlab # [ 438.234206] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:08.899Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"48e7111def8345383d5ad27e","created_at":"2026-08-16T17:06:47.480Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-114f4c9a19fb4ec8","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:47.492Z","job_size_bytes":65,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-48e7111def8345383d5ad27e: done: 0.333093 sec","job_status":"done","queue_duration_s":81.074408,"scheduling_latency_s":81.074457,"redis_calls":21,"redis_duration_s":0.008158,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.00406,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002096,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002002,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.046,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.034,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.263187,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00053108,"duration_s":0.333093,"completed_at":"2026-08-16T17:08:08.899Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.055285,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2096gitlab # [ 438.351523] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:08.902Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"5880b6e2c0a625b6c6a73ec5","created_at":"2026-08-16T17:06:47.738Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-114f4c9a19fb4ec8","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:47.753Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5880b6e2c0a625b6c6a73ec5: start","job_status":"start","queue_duration_s":81.148782,"scheduling_latency_s":81.148809}2097gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'2098gitlab # [ 438.492346] nixbot[3635]: INFO: ::ffff:127.0.0.1:36398 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK2099gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds)2100gitlab # [ 438.503786] gitaly[923]: time="2026-08-16T17:08:09.168Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMHTPMK938PQEX88HYGRB grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:08:09.167" grpc.time_ms=0.781 pid=923 span.kind=server system=grpc2101gitlab # [ 438.581806] gitaly[923]: time="2026-08-16T17:08:09.247Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMHTPMK938PQEX88HYGRB grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:08:09.246" grpc.time_ms=0.738 pid=923 span.kind=server system=grpc2102gitlab # [ 438.634140] gitaly[923]: time="2026-08-16T17:08:09.300Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMHTPMK938PQEX88HYGRB grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:08:09.298" grpc.time_ms=1.119 pid=923 span.kind=server system=grpc2103gitlab # [ 438.663867] gitaly[923]: time="2026-08-16T17:08:09.312Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMHTPMK938PQEX88HYGRB diskcache=e8a372bf-11ab-4cd3-87ef-bb7912fee0dd grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:08:39.104" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:09.105" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2104gitlab # [ 438.686117] gitaly[923]: time="2026-08-16T17:08:09.312Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=211 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7523 command.oublock=0 command.real_time_ms=199 command.spawn_token_fork_ms=1 command.system_time_ms=132 command.user_time_ms=79 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMHTPMK938PQEX88HYGRB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:08:39.104" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:09.105" grpc.time_ms=206.611 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2105gitlab # [ 438.868980] gitaly[923]: time="2026-08-16T17:08:09.534Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMHTPMK938PQEX88HYGRB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T17:08:39.532" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:09.533" grpc.time_ms=1.561 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2106gitlab # [ 438.927875] gitaly[923]: time="2026-08-16T17:08:09.593Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMHTPMK938PQEX88HYGRB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:08:39.591" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:09.592" grpc.time_ms=1.108 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2107gitlab # [ 438.972985] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:09.637Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"5880b6e2c0a625b6c6a73ec5","created_at":"2026-08-16T17:06:47.738Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-114f4c9a19fb4ec8","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:47.753Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5880b6e2c0a625b6c6a73ec5: done: 0.735867 sec","job_status":"done","queue_duration_s":81.148782,"scheduling_latency_s":81.148809,"gitaly_calls":3,"gitaly_duration_s":0.222438,"redis_calls":117,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.042215,"redis_read_bytes":457,"redis_write_bytes":27998,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001804,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001736,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.015479,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":25,"redis_queues_duration_s":0.006406,"redis_queues_read_bytes":36,"redis_queues_write_bytes":14492,"redis_queues_metadata_calls":21,"redis_queues_metadata_duration_s":0.009515,"redis_queues_metadata_read_bytes":32,"redis_queues_metadata_write_bytes":3370,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000868,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000955,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003648,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.098,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.033,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.04,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.047,"db_ci_duration_s":0.05,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.382426,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.6390608000000001,"duration_s":0.735867,"completed_at":"2026-08-16T17:08:09.637Z","load_balancing_strategy":"primary","db_duration_s":0.116778,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2108gitlab # [ 439.050156] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:09.641Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"aa2c62cb516b5227cd68ffe1","created_at":"2026-08-16T17:08:06.665Z","trace_propagation_headers":{"sentry-trace":"e4a4ed6dce5a401b86f7038d15d31640-a229722acf024c86","baggage":"sentry-trace_id=e4a4ed6dce5a401b86f7038d15d31640,sentry-release=Unknown"},"correlation_id":"01M05RMA9YKSWZEKT0TS5Z9HSF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:06.687Z","job_size_bytes":46,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-aa2c62cb516b5227cd68ffe1: start","job_status":"start","queue_duration_s":2.953528,"scheduling_latency_s":2.953567}2109gitlab # [ 439.072834] gitaly[923]: time="2026-08-16T17:08:09.738Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-08-16T23:08:09.727" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:08:09.727" grpc.time_ms=10.346 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2110gitlab # [ 439.104601] gitaly[923]: time="2026-08-16T17:08:09.770Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=595 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-16T17:08:39.751" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:09.752" grpc.time_ms=18.314 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2111gitlab # [ 439.154114] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:09.819Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"aa2c62cb516b5227cd68ffe1","created_at":"2026-08-16T17:08:06.665Z","trace_propagation_headers":{"sentry-trace":"e4a4ed6dce5a401b86f7038d15d31640-a229722acf024c86","baggage":"sentry-trace_id=e4a4ed6dce5a401b86f7038d15d31640,sentry-release=Unknown"},"correlation_id":"01M05RMA9YKSWZEKT0TS5Z9HSF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:06.687Z","job_size_bytes":46,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-aa2c62cb516b5227cd68ffe1: done: 0.178164 sec","job_status":"done","queue_duration_s":2.953528,"scheduling_latency_s":2.953567,"gitaly_calls":2,"gitaly_duration_s":0.035551,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.011894,"redis_read_bytes":69,"redis_write_bytes":4887,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.002424,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.001061,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2115,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002594,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.004597,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001218,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.113295,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00057854,"duration_s":0.178164,"completed_at":"2026-08-16T17:08:09.819Z","load_balancing_strategy":"primary","db_duration_s":0.019048,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2112gitlab # [ 439.246084] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:09.821Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"e853c79ea30d3f1edd7c1327","created_at":"2026-08-16T17:08:06.709Z","trace_propagation_headers":{"sentry-trace":"e4a4ed6dce5a401b86f7038d15d31640-a229722acf024c86","baggage":"sentry-trace_id=e4a4ed6dce5a401b86f7038d15d31640,sentry-release=Unknown"},"correlation_id":"01M05RMA9YKSWZEKT0TS5Z9HSF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:06.715Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-e853c79ea30d3f1edd7c1327: start","job_status":"start","queue_duration_s":3.106542,"scheduling_latency_s":3.10657}2113gitlab # [ 439.268290] gitaly[923]: time="2026-08-16T17:08:09.902Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF diskcache=6f831560-e786-4904-a6c7-56bbc48742f2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T23:08:09.858" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:09.859" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2114gitlab # [ 439.281630] gitaly[923]: time="2026-08-16T17:08:09.903Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=23 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1174 command.oublock=0 command.real_time_ms=41 command.spawn_token_fork_ms=8 command.system_time_ms=23 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T23:08:09.858" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:09.859" grpc.time_ms=43.659 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2115gitlab # [ 439.321474] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:09.986Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"e853c79ea30d3f1edd7c1327","created_at":"2026-08-16T17:08:06.709Z","trace_propagation_headers":{"sentry-trace":"e4a4ed6dce5a401b86f7038d15d31640-a229722acf024c86","baggage":"sentry-trace_id=e4a4ed6dce5a401b86f7038d15d31640,sentry-release=Unknown"},"correlation_id":"01M05RMA9YKSWZEKT0TS5Z9HSF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:06.715Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-e853c79ea30d3f1edd7c1327: done: 0.164878 sec","job_status":"done","queue_duration_s":3.106542,"scheduling_latency_s":3.10657,"gitaly_calls":1,"gitaly_duration_s":0.047248,"redis_calls":15,"redis_duration_s":0.006376,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000687,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002536,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001101,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002052,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.021,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.042,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.082198,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.12061654,"duration_s":0.164878,"completed_at":"2026-08-16T17:08:09.986Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.025497,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2116gitlab # [ 439.386327] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:09.989Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"a27ec7fcc9bc58b0c9a45d6a","created_at":"2026-08-16T17:08:06.879Z","trace_propagation_headers":{"sentry-trace":"e4a4ed6dce5a401b86f7038d15d31640-a229722acf024c86","baggage":"sentry-trace_id=e4a4ed6dce5a401b86f7038d15d31640,sentry-release=Unknown"},"correlation_id":"01M05RMA9YKSWZEKT0TS5Z9HSF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:06.883Z","job_size_bytes":23,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-a27ec7fcc9bc58b0c9a45d6a: start","job_status":"start","queue_duration_s":3.105979,"scheduling_latency_s":3.106023}2117gitlab # [ 439.404877] gitaly[923]: time="2026-08-16T17:08:10.068Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=595 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-16T17:08:40.048" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:10.049" grpc.time_ms=18.927 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2118gitlab # [ 439.424678] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:10.089Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"a27ec7fcc9bc58b0c9a45d6a","created_at":"2026-08-16T17:08:06.879Z","trace_propagation_headers":{"sentry-trace":"e4a4ed6dce5a401b86f7038d15d31640-a229722acf024c86","baggage":"sentry-trace_id=e4a4ed6dce5a401b86f7038d15d31640,sentry-release=Unknown"},"correlation_id":"01M05RMA9YKSWZEKT0TS5Z9HSF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:06.883Z","job_size_bytes":23,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-a27ec7fcc9bc58b0c9a45d6a: done: 0.100139 sec","job_status":"done","queue_duration_s":3.105979,"scheduling_latency_s":3.106023,"gitaly_calls":1,"gitaly_duration_s":0.02272,"redis_calls":16,"redis_duration_s":0.007009,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000593,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001937,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.003307,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001172,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.062757,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.100139,"completed_at":"2026-08-16T17:08:10.089Z","load_balancing_strategy":"primary","db_duration_s":0.005479,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2119gitlab # [ 439.470372] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:10.093Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"82f7321790f9ef126b9d2dd4","created_at":"2026-08-16T17:08:07.697Z","trace_propagation_headers":{"sentry-trace":"e4a4ed6dce5a401b86f7038d15d31640-a229722acf024c86","baggage":"sentry-trace_id=e4a4ed6dce5a401b86f7038d15d31640,sentry-release=Unknown"},"correlation_id":"01M05RMA9YKSWZEKT0TS5Z9HSF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c9cffabc8e68faf856a5c13c0f260700d6bbb38732e2a3433687e9dfc416f9cb","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:07.705Z","job_size_bytes":467,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-82f7321790f9ef126b9d2dd4: start","job_status":"start","queue_duration_s":2.387908,"scheduling_latency_s":2.387947}2120gitlab # [ 439.487567] gitaly[923]: time="2026-08-16T17:08:10.143Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:08:40.141" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:10.142" grpc.time_ms=1.008 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2121gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'2122gitlab # [ 439.500556] gitaly[923]: time="2026-08-16T17:08:10.165Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-16T17:08:20.117" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:10.147" grpc.time_ms=17.262 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2123gitlab # [ 439.550163] nixbot[3635]: INFO: ::ffff:127.0.0.1:36414 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK2124gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds)2125gitlab # [ 439.679087] gitaly[923]: time="2026-08-16T17:08:10.343Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T17:08:40.341" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:10.342" grpc.time_ms=1.357 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2126gitlab # [ 439.716254] gitaly[923]: time="2026-08-16T17:08:10.353Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=37 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-16T17:08:40.348" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:10.348" grpc.time_ms=4.335 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2127gitlab # [ 439.872328] gitaly[923]: time="2026-08-16T17:08:10.538Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:08:20.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:10.520" grpc.time_ms=17.478 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2128gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'2129gitlab # [ 440.608321] nixbot[3635]: INFO: ::ffff:127.0.0.1:36428 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK2130gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds)2131gitlab # [ 440.697283] gitaly[923]: time="2026-08-16T17:08:11.362Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=881 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=3 command.system_time_ms=16 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-16T17:08:41.034" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:11.334" grpc.time_ms=27.124 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2132gitlab # [ 440.739495] gitaly[923]: time="2026-08-16T17:08:11.391Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-16T17:08:41.065" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:11.366" grpc.time_ms=25.178 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2133gitlab # [ 440.792711] sidekiq-cluster[3532]: {"severity":"WARN","time":"2026-08-16T17:08:11.457Z","class":"CreatePipelineWorker","correlation_id":"01M05RMA9YKSWZEKT0TS5Z9HSF","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"3139bc27e7fce8d04c34183bfc6fdaf8b6833a53","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"3139bc27e7fce8d04c34183bfc6fdaf8b6833a53","ref":"refs/heads/master"},"retry":0}2134gitlab # [ 440.814573] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:11.475Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"82f7321790f9ef126b9d2dd4","created_at":"2026-08-16T17:08:07.697Z","trace_propagation_headers":{"sentry-trace":"e4a4ed6dce5a401b86f7038d15d31640-a229722acf024c86","baggage":"sentry-trace_id=e4a4ed6dce5a401b86f7038d15d31640,sentry-release=Unknown"},"correlation_id":"01M05RMA9YKSWZEKT0TS5Z9HSF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c9cffabc8e68faf856a5c13c0f260700d6bbb38732e2a3433687e9dfc416f9cb","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:07.705Z","job_size_bytes":467,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-82f7321790f9ef126b9d2dd4: done: 1.382467 sec","job_status":"done","queue_duration_s":2.387908,"scheduling_latency_s":2.387947,"gitaly_calls":7,"gitaly_duration_s":0.117225,"redis_calls":51,"redis_duration_s":0.019051000000000002,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.001549,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.008181,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002493,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.004388,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00244,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.05,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.042,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.168225,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00078576,"duration_s":1.382467,"completed_at":"2026-08-16T17:08:11.475Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.090277,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2135gitlab # [ 440.902174] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:11.479Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"ff68ec8b-6954-4f34-83da-cbd08eeec907\"}"],"class":"WebHookWorker","jid":"e37059354608c0dad2f2c064","created_at":"2026-08-16T17:08:07.853Z","trace_propagation_headers":{"sentry-trace":"e4a4ed6dce5a401b86f7038d15d31640-a229722acf024c86","baggage":"sentry-trace_id=e4a4ed6dce5a401b86f7038d15d31640,sentry-release=Unknown"},"correlation_id":"01M05RMA9YKSWZEKT0TS5Z9HSF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2edd7f40c4b077f49c6b3520b91cf0622b68069aaedfbeed2f741b03a2c7a3ad","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:07.859Z","job_size_bytes":1751,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-e37059354608c0dad2f2c064: start","job_status":"start","queue_duration_s":3.619783,"scheduling_latency_s":3.619828}2136gitlab # [ 441.069310] nixbot[3635]: INFO: ::ffff:127.0.0.1:58196 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2137gitlab # [ 441.113149] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:11.777Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"ff68ec8b-6954-4f34-83da-cbd08eeec907\"}"],"class":"WebHookWorker","jid":"e37059354608c0dad2f2c064","created_at":"2026-08-16T17:08:07.853Z","trace_propagation_headers":{"sentry-trace":"e4a4ed6dce5a401b86f7038d15d31640-a229722acf024c86","baggage":"sentry-trace_id=e4a4ed6dce5a401b86f7038d15d31640,sentry-release=Unknown"},"correlation_id":"01M05RMA9YKSWZEKT0TS5Z9HSF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2edd7f40c4b077f49c6b3520b91cf0622b68069aaedfbeed2f741b03a2c7a3ad","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:07.859Z","job_size_bytes":1751,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-e37059354608c0dad2f2c064: done: 0.298347 sec","job_status":"done","queue_duration_s":3.619783,"scheduling_latency_s":3.619828,"redis_calls":19,"redis_duration_s":0.007536,"redis_read_bytes":32,"redis_write_bytes":5367,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001937,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000773,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00312,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001706,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.08840989999998783,"cpu_s":0.18219,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0007793,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.298347,"completed_at":"2026-08-16T17:08:11.777Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005924,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2138gitlab # [ 441.231632] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:11.781Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"ba789d95a292fa3f4f9b1600","created_at":"2026-08-16T17:08:08.024Z","trace_propagation_headers":{"sentry-trace":"cf80ac8fe018495f99f53478a2596cb3-d689edc6a35e40be","baggage":"sentry-trace_id=cf80ac8fe018495f99f53478a2596cb3,sentry-release=Unknown"},"correlation_id":"01M05RMG0NSRS5JN7G076JGYE8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"e853c79ea30d3f1edd7c1327","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:08.029Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-ba789d95a292fa3f4f9b1600: start","job_status":"start","queue_duration_s":3.752578,"scheduling_latency_s":3.75263}2139gitlab # [ 441.258588] gitaly[923]: time="2026-08-16T17:08:11.894Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 diskcache=dbb2d18c-4852-4b51-98e3-c4730861b9fd grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T23:08:11.823" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:11.824" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2140gitlab # [ 441.272150] gitaly[923]: time="2026-08-16T17:08:11.895Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=289 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T23:08:11.823" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:11.824" grpc.time_ms=70.444 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2141gitlab # [ 441.287919] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:11.930Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"ba789d95a292fa3f4f9b1600","created_at":"2026-08-16T17:08:08.024Z","trace_propagation_headers":{"sentry-trace":"cf80ac8fe018495f99f53478a2596cb3-d689edc6a35e40be","baggage":"sentry-trace_id=cf80ac8fe018495f99f53478a2596cb3,sentry-release=Unknown"},"correlation_id":"01M05RMG0NSRS5JN7G076JGYE8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"e853c79ea30d3f1edd7c1327","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:08.029Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-ba789d95a292fa3f4f9b1600: done: 0.14877 sec","job_status":"done","queue_duration_s":3.752578,"scheduling_latency_s":3.75263,"gitaly_calls":1,"gitaly_duration_s":0.075199,"redis_calls":12,"redis_duration_s":0.009184999999999999,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003352,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.003204,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002629,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.011,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.011,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.052122,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.10553462,"duration_s":0.14877,"completed_at":"2026-08-16T17:08:11.930Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009507,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2142gitlab # [ 441.334787] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:11.935Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"52acb1530fb0a8a95fdd80e1","created_at":"2026-08-16T17:08:08.256Z","trace_propagation_headers":{"sentry-trace":"cf80ac8fe018495f99f53478a2596cb3-d689edc6a35e40be","baggage":"sentry-trace_id=cf80ac8fe018495f99f53478a2596cb3,sentry-release=Unknown"},"correlation_id":"01M05RMG0NSRS5JN7G076JGYE8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:31bf8c8b10bf503ec4477477ccb7f662a46907d329ed24c78bdea10e274679d8","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:08.261Z","job_size_bytes":467,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-52acb1530fb0a8a95fdd80e1: start","job_status":"start","queue_duration_s":3.674111,"scheduling_latency_s":3.674159}2143gitlab # [ 441.352169] gitaly[923]: time="2026-08-16T17:08:11.982Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=577 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05RQ4W80H6MX09KBTX03NNZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:08:11.964" grpc.time_ms=17.23 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc2144gitlab # [ 441.366124] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:08:11 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1972145gitlab # [ 441.368257] gitaly[923]: time="2026-08-16T17:08:11.994Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:08:41.692" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:11.992" grpc.time_ms=1.149 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2146gitlab # [ 441.380585] gitaly[923]: time="2026-08-16T17:08:12.018Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-16T17:08:21.038" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:11.999" grpc.time_ms=17.806 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2147gitlab # [ 441.426984] gitaly[923]: time="2026-08-16T17:08:12.092Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T17:08:42.090" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:12.091" grpc.time_ms=1.384 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2148gitlab # [ 441.449287] gitaly[923]: time="2026-08-16T17:08:12.103Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=26 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-16T17:08:42.098" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:12.099" grpc.time_ms=3.965 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2149gitlab # [ 441.493430] gitaly[923]: time="2026-08-16T17:08:12.159Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:08:22.116" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:12.147" grpc.time_ms=11.664 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2150gitlab # [ 441.575341] gitaly[923]: time="2026-08-16T17:08:12.241Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ52H8QTTBDMJAB31XTEH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:08:12.222" pid=923 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2151gitlab # [ 441.587252] gitaly[923]: time="2026-08-16T17:08:12.241Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ52H8QTTBDMJAB31XTEH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:08:12.222" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc2152gitlab # [ 441.601998] gitlab-workhorse[825]: time="2026-08-16T17:08:12Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672153gitlab # [ 441.603811] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:08:12 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 2572154gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'2155gitlab # [ 441.606849] gitaly[923]: time="2026-08-16T17:08:12.242Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ52H8QTTBDMJAB31XTEH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:08:12.222" grpc.time_ms=19.943 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc2156gitlab # [ 441.639058] nixbot[3635]: {"ts": "2026-08-16T17:08:12.304Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}2157gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds)2158gitlab # [ 441.671350] nixbot[3635]: INFO: ::ffff:127.0.0.1:58202 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK2159gitlab # [ 441.813912] gitaly[923]: time="2026-08-16T17:08:12.478Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ5D88WJ91F0Z0M3TANXF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:08:42.476" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:12.477" grpc.time_ms=1.157 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2160gitlab # [ 441.921919] gitaly[923]: time="2026-08-16T17:08:12.587Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RQ5D88WJ91F0Z0M3TANXF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:08:22.148" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:12.568" grpc.time_ms=18.966 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2161gitlab # [ 442.004846] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:08:12 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 3412162gitlab # [ 442.014131] nixbot[3635]: {"ts": "2026-08-16T17:08:12.672Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 \"HTTP/1.1 201 Created\""}2163gitlab # [ 442.140187] gitaly[923]: time="2026-08-16T17:08:12.806Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ5R9P52NDBE3KB8N69H7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:08:42.603" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:12.804" grpc.time_ms=1.207 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2164gitlab # [ 442.176426] gitaly[923]: time="2026-08-16T17:08:12.842Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=882 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=4 command.system_time_ms=8 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-16T17:08:42.520" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:12.821" grpc.time_ms=20.545 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2165gitlab # [ 442.206779] gitaly[923]: time="2026-08-16T17:08:12.858Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-16T17:08:42.545" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:12.845" grpc.time_ms=12.928 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2166gitlab # [ 442.227099] sidekiq-cluster[3532]: {"severity":"WARN","time":"2026-08-16T17:08:12.879Z","class":"CreatePipelineWorker","correlation_id":"01M05RMG0NSRS5JN7G076JGYE8","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"3139bc27e7fce8d04c34183bfc6fdaf8b6833a53","after":"4d08eaf3d0520ce6ede23381e4a7abb44d0744a1","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"4d08eaf3d0520ce6ede23381e4a7abb44d0744a1","ref":"refs/heads/master"},"retry":0}2167gitlab # [ 442.237047] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:12.892Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"52acb1530fb0a8a95fdd80e1","created_at":"2026-08-16T17:08:08.256Z","trace_propagation_headers":{"sentry-trace":"cf80ac8fe018495f99f53478a2596cb3-d689edc6a35e40be","baggage":"sentry-trace_id=cf80ac8fe018495f99f53478a2596cb3,sentry-release=Unknown"},"correlation_id":"01M05RMG0NSRS5JN7G076JGYE8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:31bf8c8b10bf503ec4477477ccb7f662a46907d329ed24c78bdea10e274679d8","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:08.261Z","job_size_bytes":467,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-52acb1530fb0a8a95fdd80e1: done: 0.956933 sec","job_status":"done","queue_duration_s":3.674111,"scheduling_latency_s":3.674159,"gitaly_calls":7,"gitaly_duration_s":0.100427,"redis_calls":33,"redis_duration_s":0.008609,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.001137,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002163,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003949,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00136,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.038,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.035,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.824683,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.956933,"completed_at":"2026-08-16T17:08:12.892Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.037386,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2168gitlab # [ 442.294648] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:12.896Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"ed6ba2f1-194a-4bfe-87c2-229182a0085c\"}"],"class":"WebHookWorker","jid":"5a1073bb8093975dc8ea1700","created_at":"2026-08-16T17:08:08.291Z","trace_propagation_headers":{"sentry-trace":"cf80ac8fe018495f99f53478a2596cb3-d689edc6a35e40be","baggage":"sentry-trace_id=cf80ac8fe018495f99f53478a2596cb3,sentry-release=Unknown"},"correlation_id":"01M05RMG0NSRS5JN7G076JGYE8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2bb92d81500effe3a5955f6968e9d1177698fbf802b941fb9baa2da63e0761a5","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:08.296Z","job_size_bytes":1749,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-5a1073bb8093975dc8ea1700: start","job_status":"start","queue_duration_s":4.599838,"scheduling_latency_s":4.59989}2169gitlab # [ 442.313816] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:12.968Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"ed6ba2f1-194a-4bfe-87c2-229182a0085c\"}"],"class":"WebHookWorker","jid":"5a1073bb8093975dc8ea1700","created_at":"2026-08-16T17:08:08.291Z","trace_propagation_headers":{"sentry-trace":"cf80ac8fe018495f99f53478a2596cb3-d689edc6a35e40be","baggage":"sentry-trace_id=cf80ac8fe018495f99f53478a2596cb3,sentry-release=Unknown"},"correlation_id":"01M05RMG0NSRS5JN7G076JGYE8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2bb92d81500effe3a5955f6968e9d1177698fbf802b941fb9baa2da63e0761a5","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:08.296Z","job_size_bytes":1749,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-5a1073bb8093975dc8ea1700: done: 0.072031 sec","job_status":"done","queue_duration_s":4.599838,"scheduling_latency_s":4.59989,"redis_calls":14,"redis_duration_s":0.008709999999999999,"redis_read_bytes":26,"redis_write_bytes":4685,"redis_queues_calls":2,"redis_queues_duration_s":0.001429,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004042,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003239,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.008418440000014016,"cpu_s":0.044406,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.072031,"completed_at":"2026-08-16T17:08:12.968Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003788,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2170gitlab # [ 442.360608] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:12.971Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"fcf9b96e465de94ed927d60f","created_at":"2026-08-16T17:08:09.076Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.083Z","job_size_bytes":23,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-fcf9b96e465de94ed927d60f: start","job_status":"start","queue_duration_s":3.888255,"scheduling_latency_s":3.888311}2171gitlab # [ 442.376770] nixbot[3635]: INFO: ::ffff:127.0.0.1:58214 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2172gitlab # [ 442.378001] gitaly[923]: time="2026-08-16T17:08:12.984Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=6 command.system_time_ms=4 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M05RQ5R9P52NDBE3KB8N69H7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:08:22.043" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:12.964" grpc.time_ms=19.847 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2173gitlab # [ 442.449735] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.112Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"fcf9b96e465de94ed927d60f","created_at":"2026-08-16T17:08:09.076Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.083Z","job_size_bytes":23,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-fcf9b96e465de94ed927d60f: done: 0.141252 sec","job_status":"done","queue_duration_s":3.888255,"scheduling_latency_s":3.888311,"redis_calls":10,"redis_duration_s":0.006906000000000001,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00111,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003954,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001842,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.099208,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00085888,"duration_s":0.141252,"completed_at":"2026-08-16T17:08:13.112Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027228,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2174gitlab # [ 442.519345] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.117Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"9fc05a929bc9bacf59c363bb","created_at":"2026-08-16T17:08:09.323Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.332Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-9fc05a929bc9bacf59c363bb: start","job_status":"start","queue_duration_s":3.784589,"scheduling_latency_s":3.784621}2175gitlab # [ 442.537420] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.163Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"9fc05a929bc9bacf59c363bb","created_at":"2026-08-16T17:08:09.323Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.332Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-9fc05a929bc9bacf59c363bb: done: 0.04697 sec","job_status":"done","queue_duration_s":3.784589,"scheduling_latency_s":3.784621,"redis_calls":10,"redis_duration_s":0.003589,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000392,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001602,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001595,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031316,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000464,"duration_s":0.04697,"completed_at":"2026-08-16T17:08:13.163Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006258,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2176gitlab # [ 442.582021] nixbot[3635]: {"ts": "2026-08-16T17:08:13.135Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 \"HTTP/1.1 201 Created\""}2177gitlab # [ 442.585264] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:08:13 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 4492178gitlab # [ 442.587740] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:08:13 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 2292179gitlab # [ 442.590054] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.169Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"ff2c7b031e86e401c9dd2a8f","created_at":"2026-08-16T17:08:09.357Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.369Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-ff2c7b031e86e401c9dd2a8f: start","job_status":"start","queue_duration_s":3.800044,"scheduling_latency_s":3.800066}2180gitlab # [ 442.606170] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.210Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"ff2c7b031e86e401c9dd2a8f","created_at":"2026-08-16T17:08:09.357Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.369Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-ff2c7b031e86e401c9dd2a8f: done: 0.041206 sec","job_status":"done","queue_duration_s":3.800044,"scheduling_latency_s":3.800066,"redis_calls":10,"redis_duration_s":0.001567,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000352,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000866,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000349,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02891,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025596,"duration_s":0.041206,"completed_at":"2026-08-16T17:08:13.210Z","load_balancing_strategy":"primary","db_duration_s":0.005994,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2181gitlab # [ 442.651102] gitaly[923]: time="2026-08-16T17:08:13.208Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=4 command.system_time_ms=3 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M05RQ61K1PPQTAYNMF297SZ2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=196 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:08:13.187" grpc.time_ms=20.926 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc2182gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'2183gitlab # [ 442.664526] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.212Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"7e8242966fabbeda96d3a9d3","created_at":"2026-08-16T17:08:09.403Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.415Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-7e8242966fabbeda96d3a9d3: start","job_status":"start","queue_duration_s":3.796364,"scheduling_latency_s":3.796381}2184gitlab # [ 442.679455] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.254Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"7e8242966fabbeda96d3a9d3","created_at":"2026-08-16T17:08:09.403Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.415Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-7e8242966fabbeda96d3a9d3: done: 0.042289 sec","job_status":"done","queue_duration_s":3.796364,"scheduling_latency_s":3.796381,"redis_calls":13,"redis_duration_s":0.001846,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00043,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000801,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000325,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00029,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026705,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023474,"duration_s":0.042289,"completed_at":"2026-08-16T17:08:13.254Z","load_balancing_strategy":"primary","db_duration_s":0.007385,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2185gitlab # [ 442.723980] gitaly[923]: time="2026-08-16T17:08:13.243Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ66YRBEKX0Q0KDGVQC9J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:08:43.042" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:13.243" grpc.time_ms=0.616 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2186gitlab # [ 442.736645] nixbot[3635]: {"ts": "2026-08-16T17:08:13.368Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 \"HTTP/1.1 201 Created\""}2187gitlab # [ 442.744208] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.255Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"3846adde843b6561ef2ea312","created_at":"2026-08-16T17:08:09.417Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.428Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-3846adde843b6561ef2ea312: start","job_status":"start","queue_duration_s":3.82724,"scheduling_latency_s":3.827257}2188gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.13 seconds)2189gitlab # [ 442.764352] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.295Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"3846adde843b6561ef2ea312","created_at":"2026-08-16T17:08:09.417Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.428Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-3846adde843b6561ef2ea312: done: 0.039826 sec","job_status":"done","queue_duration_s":3.82724,"scheduling_latency_s":3.827257,"redis_calls":10,"redis_duration_s":0.0023350000000000003,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000294,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000877,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001164,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024898,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002253,"duration_s":0.039826,"completed_at":"2026-08-16T17:08:13.295Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007631,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2190gitlab # [ 442.811535] gitlab-workhorse[825]: time="2026-08-16T17:08:13Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672191gitlab # [ 442.813578] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:08:13 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1422192gitlab # [ 442.815489] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:08:13 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2152193gitlab # [ 442.818505] gitaly[923]: time="2026-08-16T17:08:13.303Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05RQ66YRBEKX0Q0KDGVQC9J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:08:23.288" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:13.288" grpc.time_ms=14.856 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2194gitlab # [ 442.832660] nix-daemon[3858]: accepted connection from pid 4411, user nixbot2195gitlab # [ 442.833651] nixbot[3635]: INFO: ::ffff:127.0.0.1:58218 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK2196gitlab # [ 442.835613] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.297Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"302c77b25996c0c79a7c8d4e","created_at":"2026-08-16T17:08:09.429Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.440Z","job_size_bytes":19,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-302c77b25996c0c79a7c8d4e: start","job_status":"start","queue_duration_s":3.856465,"scheduling_latency_s":3.856485}2197gitlab # [ 442.853210] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.337Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"302c77b25996c0c79a7c8d4e","created_at":"2026-08-16T17:08:09.429Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.440Z","job_size_bytes":19,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-302c77b25996c0c79a7c8d4e: done: 0.040442 sec","job_status":"done","queue_duration_s":3.856465,"scheduling_latency_s":3.856485,"redis_calls":11,"redis_duration_s":0.0066879999999999995,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000455,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.005377,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000856,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021329,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003706,"duration_s":0.040442,"completed_at":"2026-08-16T17:08:13.337Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006345,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2198gitlab # [ 442.897334] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:08:13 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 752199gitlab # [ 442.899345] gitlab-workhorse[825]: time="2026-08-16T17:08:13Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672200gitlab # [ 442.901264] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:08:13 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 662201gitlab # [ 442.903131] gitaly[923]: time="2026-08-16T17:08:13.353Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ68W49YCPMJESK7W9NZZ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:08:13.334" pid=923 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2202gitlab # [ 442.913483] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.339Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"c3633526ab7f6d427a27a3e0","created_at":"2026-08-16T17:08:09.449Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.457Z","job_size_bytes":66,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-c3633526ab7f6d427a27a3e0: start","job_status":"start","queue_duration_s":3.881551,"scheduling_latency_s":3.881568}2203gitlab # [ 442.930675] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.379Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"c3633526ab7f6d427a27a3e0","created_at":"2026-08-16T17:08:09.449Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.457Z","job_size_bytes":66,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-c3633526ab7f6d427a27a3e0: done: 0.040232 sec","job_status":"done","queue_duration_s":3.881551,"scheduling_latency_s":3.881568,"redis_calls":10,"redis_duration_s":0.003202,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000469,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001999,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000734,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023351,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004566,"duration_s":0.040232,"completed_at":"2026-08-16T17:08:13.379Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008969,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2204gitlab # [ 442.975633] gitaly[923]: time="2026-08-16T17:08:13.353Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=4 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ68W49YCPMJESK7W9NZZ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:08:13.334" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc2205gitlab # [ 442.989530] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.384Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"f6e7ec64afc7c1384f2ba926","created_at":"2026-08-16T17:08:09.459Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.467Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-f6e7ec64afc7c1384f2ba926: start","job_status":"start","queue_duration_s":3.916204,"scheduling_latency_s":3.916229}2206gitlab # [ 443.005715] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.440Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"f6e7ec64afc7c1384f2ba926","created_at":"2026-08-16T17:08:09.459Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.467Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-f6e7ec64afc7c1384f2ba926: done: 0.056821 sec","job_status":"done","queue_duration_s":3.916204,"scheduling_latency_s":3.916229,"redis_calls":10,"redis_duration_s":0.004273,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000391,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003108,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000774,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038643,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00172938,"duration_s":0.056821,"completed_at":"2026-08-16T17:08:13.440Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0058,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2207gitlab # [ 443.050964] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:08:13 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 602208gitlab # [ 443.053024] gitaly[923]: time="2026-08-16T17:08:13.354Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=4 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ68W49YCPMJESK7W9NZZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:08:13.334" grpc.time_ms=19.305 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc2209gitlab # [ 443.067465] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.442Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"c9e9cd0ff30ddd84089fa5f3","created_at":"2026-08-16T17:08:09.481Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.487Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-c9e9cd0ff30ddd84089fa5f3: start","job_status":"start","queue_duration_s":3.954937,"scheduling_latency_s":3.954956}2210gitlab # [ 443.084920] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.486Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"c9e9cd0ff30ddd84089fa5f3","created_at":"2026-08-16T17:08:09.481Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.487Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-c9e9cd0ff30ddd84089fa5f3: done: 0.043713 sec","job_status":"done","queue_duration_s":3.954937,"scheduling_latency_s":3.954956,"redis_calls":10,"redis_duration_s":0.001992,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000451,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001022,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000519,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024505,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00029514,"duration_s":0.043713,"completed_at":"2026-08-16T17:08:13.486Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009851,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2211gitlab # [ 443.129286] gitaly[923]: time="2026-08-16T17:08:13.481Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=577 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=8 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RQ6EY7BFSVPY0Z3R896RJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=194 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:08:13.464" grpc.time_ms=17.22 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc2212gitlab # [ 443.142068] gitaly[923]: time="2026-08-16T17:08:13.549Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ6HBQWMA47T2PFHTBTZ6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:08:13.541" pid=923 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2213gitlab # [ 443.152752] gitlab-workhorse[825]: time="2026-08-16T17:08:13Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2162214gitlab # [ 443.154678] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:08:13 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 862215gitlab # [ 443.156649] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.492Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"05e71ac60aa9c8dc74210fef","created_at":"2026-08-16T17:08:09.488Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.494Z","job_size_bytes":6,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-05e71ac60aa9c8dc74210fef: start","job_status":"start","queue_duration_s":3.997731,"scheduling_latency_s":3.997755}2216gitlab # [ 443.172970] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.525Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"05e71ac60aa9c8dc74210fef","created_at":"2026-08-16T17:08:09.488Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.494Z","job_size_bytes":6,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-05e71ac60aa9c8dc74210fef: done: 0.032745 sec","job_status":"done","queue_duration_s":3.997731,"scheduling_latency_s":3.997755,"redis_calls":10,"redis_duration_s":0.00897,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002763,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005195,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001012,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015753,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00231354,"duration_s":0.032745,"completed_at":"2026-08-16T17:08:13.525Z","load_balancing_strategy":"primary","db_duration_s":0.001852,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2217gitlab # [ 443.217176] gitaly[923]: time="2026-08-16T17:08:13.549Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ6HBQWMA47T2PFHTBTZ6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:08:13.541" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc2218gitlab # [ 443.231492] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.527Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"0dbacd7b09c9c884fa2441e1","created_at":"2026-08-16T17:08:09.495Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.502Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-0dbacd7b09c9c884fa2441e1: start","job_status":"start","queue_duration_s":4.025105,"scheduling_latency_s":4.025128}2219gitlab # [ 443.248339] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.572Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"0dbacd7b09c9c884fa2441e1","created_at":"2026-08-16T17:08:09.495Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.502Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-0dbacd7b09c9c884fa2441e1: done: 0.04541 sec","job_status":"done","queue_duration_s":4.025105,"scheduling_latency_s":4.025128,"redis_calls":10,"redis_duration_s":0.0017720000000000001,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000327,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001056,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000389,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028512,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003623,"duration_s":0.04541,"completed_at":"2026-08-16T17:08:13.572Z","load_balancing_strategy":"primary","db_duration_s":0.009527,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2220gitlab # [ 443.291471] gitaly[923]: time="2026-08-16T17:08:13.550Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ6HBQWMA47T2PFHTBTZ6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:08:13.541" grpc.time_ms=8.165 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc2221gitlab # [ 443.306237] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.574Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"06b20e07e1d94bb39291730a","created_at":"2026-08-16T17:08:09.510Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.517Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-06b20e07e1d94bb39291730a: start","job_status":"start","queue_duration_s":4.056847,"scheduling_latency_s":4.056867}2222gitlab # [ 443.323066] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.652Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"06b20e07e1d94bb39291730a","created_at":"2026-08-16T17:08:09.510Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.517Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-06b20e07e1d94bb39291730a: done: 0.078606 sec","job_status":"done","queue_duration_s":4.056847,"scheduling_latency_s":4.056867,"redis_calls":14,"redis_duration_s":0.004879,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000264,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003639,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000976,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049267,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0022352,"duration_s":0.078606,"completed_at":"2026-08-16T17:08:13.652Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01611,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2223gitlab # [ 443.368526] gitaly[923]: time="2026-08-16T17:08:13.644Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=577 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RQ6MGJDYTESND1HQF77P4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:08:13.636" grpc.time_ms=7.403 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc2224gitlab # [ 443.382145] gitaly[923]: time="2026-08-16T17:08:13.732Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ6PG8D7GDC3N0B9BBN1B grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:08:13.708" pid=923 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc2225gitlab # [ 443.392865] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.655Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"071180749bab81b53228fedb","created_at":"2026-08-16T17:08:09.787Z","trace_propagation_headers":{"sentry-trace":"e4a4ed6dce5a401b86f7038d15d31640-2938f90723dc4831","baggage":"sentry-trace_id=e4a4ed6dce5a401b86f7038d15d31640,sentry-release=Unknown"},"correlation_id":"01M05RMA9YKSWZEKT0TS5Z9HSF","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.796Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-071180749bab81b53228fedb: start","job_status":"start","queue_duration_s":3.859238,"scheduling_latency_s":3.859264}2226gitlab # [ 443.408740] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.720Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"071180749bab81b53228fedb","created_at":"2026-08-16T17:08:09.787Z","trace_propagation_headers":{"sentry-trace":"e4a4ed6dce5a401b86f7038d15d31640-2938f90723dc4831","baggage":"sentry-trace_id=e4a4ed6dce5a401b86f7038d15d31640,sentry-release=Unknown"},"correlation_id":"01M05RMA9YKSWZEKT0TS5Z9HSF","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.796Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-071180749bab81b53228fedb: done: 0.064518 sec","job_status":"done","queue_duration_s":3.859238,"scheduling_latency_s":3.859264,"redis_calls":19,"redis_duration_s":0.008888,"redis_read_bytes":21,"redis_write_bytes":4292,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.003629,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000844,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2263,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002996,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001419,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038116,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01004002,"duration_s":0.064518,"completed_at":"2026-08-16T17:08:13.720Z","load_balancing_strategy":"primary","db_duration_s":0.011555,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2227gitlab # [ 443.454567] gitaly[923]: time="2026-08-16T17:08:13.733Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1101 command.oublock=0 command.real_time_ms=22 command.spawn_token_fork_ms=0 command.system_time_ms=17 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ6PG8D7GDC3N0B9BBN1B grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:08:13.708" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc2228gitlab # [ 443.468064] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.721Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","e37059354608c0dad2f2c064"],"class":"WebHooks::LogExecutionWorker","jid":"d1cb3286e0c0b79b24731f13","created_at":"2026-08-16T17:08:11.741Z","trace_propagation_headers":{"sentry-trace":"e4a4ed6dce5a401b86f7038d15d31640-52a209f7996c40f5","baggage":"sentry-trace_id=e4a4ed6dce5a401b86f7038d15d31640,sentry-release=Unknown"},"correlation_id":"01M05RMA9YKSWZEKT0TS5Z9HSF","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ce7a66dc3ed48916adbc104cb372ad2bb8bbc2ff161a2e36a7a63034a37431ca","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:11.755Z","job_size_bytes":2593,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-d1cb3286e0c0b79b24731f13: start","job_status":"start","queue_duration_s":1.966365,"scheduling_latency_s":1.966384}2229gitlab # [ 443.485205] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.781Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","e37059354608c0dad2f2c064"],"class":"WebHooks::LogExecutionWorker","jid":"d1cb3286e0c0b79b24731f13","created_at":"2026-08-16T17:08:11.741Z","trace_propagation_headers":{"sentry-trace":"e4a4ed6dce5a401b86f7038d15d31640-52a209f7996c40f5","baggage":"sentry-trace_id=e4a4ed6dce5a401b86f7038d15d31640,sentry-release=Unknown"},"correlation_id":"01M05RMA9YKSWZEKT0TS5Z9HSF","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ce7a66dc3ed48916adbc104cb372ad2bb8bbc2ff161a2e36a7a63034a37431ca","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:11.755Z","job_size_bytes":2593,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-d1cb3286e0c0b79b24731f13: done: 0.060205 sec","job_status":"done","queue_duration_s":1.966365,"scheduling_latency_s":1.966384,"redis_calls":10,"redis_duration_s":0.002126,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00088,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000882,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000364,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040866,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025626,"duration_s":0.060205,"completed_at":"2026-08-16T17:08:13.781Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013636,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2230gitlab # [ 443.529888] gitaly[923]: time="2026-08-16T17:08:13.733Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1101 command.oublock=0 command.real_time_ms=22 command.spawn_token_fork_ms=0 command.system_time_ms=17 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ6PG8D7GDC3N0B9BBN1B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:08:13.708" grpc.time_ms=24.558 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc2231gitlab # [ 443.544984] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:08:14 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 3862232gitlab # [ 443.547690] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.785Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"90aca753a214e829f7ed1e94","created_at":"2026-08-16T17:08:12.639Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-012a1087f8c4486d","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:12.647Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-90aca753a214e829f7ed1e94: start","job_status":"start","queue_duration_s":1.13857,"scheduling_latency_s":1.138589}2233gitlab # [ 443.563679] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.127Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"90aca753a214e829f7ed1e94","created_at":"2026-08-16T17:08:12.639Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-012a1087f8c4486d","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:12.647Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3532,"job_status":"rescheduled","message":"PipelineProcessWorker JID-90aca753a214e829f7ed1e94: rescheduled"}2234gitlab # [ 443.578494] nixbot[3635]: {"ts": "2026-08-16T17:08:14.168Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 \"HTTP/1.1 201 Created\""}2235gitlab # [ 443.581277] nixbot[3635]: {"ts": "2026-08-16T17:08:14.179Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-4d08eaf3d052-4"}2236gitlab # [ 443.583510] gitaly[923]: time="2026-08-16T17:08:13.852Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ6TMHDKTK0ZRJ4W5FX89 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:08:43.850" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:13.851" grpc.time_ms=0.917 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2237gitlab # [ 443.596348] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.134Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"90aca753a214e829f7ed1e94","created_at":"2026-08-16T17:08:12.639Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-012a1087f8c4486d","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:12.647Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-90aca753a214e829f7ed1e94: done: 0.349146 sec","job_status":"done","queue_duration_s":1.13857,"scheduling_latency_s":1.138589,"gitaly_calls":3,"gitaly_duration_s":0.151916,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.014951,"redis_read_bytes":148,"redis_write_bytes":18012,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.001384,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000809,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.003141,"redis_queues_read_bytes":26,"redis_queues_write_bytes":12311,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.005204,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000241,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000342,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002446,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.044,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.009,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.009,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.021,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.141851,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.30075178,"duration_s":0.349146,"completed_at":"2026-08-16T17:08:14.134Z","load_balancing_strategy":"primary","db_duration_s":0.047191,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2238gitlab # [ 443.647337] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.136Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","5a1073bb8093975dc8ea1700"],"class":"WebHooks::LogExecutionWorker","jid":"1dfd5d9e504491b338137f3d","created_at":"2026-08-16T17:08:12.949Z","trace_propagation_headers":{"sentry-trace":"cf80ac8fe018495f99f53478a2596cb3-1da00cd0d0f24ac9","baggage":"sentry-trace_id=cf80ac8fe018495f99f53478a2596cb3,sentry-release=Unknown"},"correlation_id":"01M05RMG0NSRS5JN7G076JGYE8","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:24e3310ee378f8e39476b17cb9b23b083d7fa8777eabdf29919a23c77a17fd2d","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:12.954Z","job_size_bytes":2592,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-1dfd5d9e504491b338137f3d: start","job_status":"start","queue_duration_s":1.182003,"scheduling_latency_s":1.182025}2239gitlab # [ 443.665502] nix-daemon[3858]: accepted connection from pid 4496, user nixbot2240gitlab # [ 443.666406] nix-daemon[3858]: accepted connection from pid 4504, user nixbot2241gitlab # [ 443.667295] gitaly[923]: time="2026-08-16T17:08:13.876Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=590 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RQ6TMHDKTK0ZRJ4W5FX89 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-16T17:08:43.864" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:13.865" grpc.time_ms=10.82 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2242gitlab # [ 443.681146] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.168Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","5a1073bb8093975dc8ea1700"],"class":"WebHooks::LogExecutionWorker","jid":"1dfd5d9e504491b338137f3d","created_at":"2026-08-16T17:08:12.949Z","trace_propagation_headers":{"sentry-trace":"cf80ac8fe018495f99f53478a2596cb3-1da00cd0d0f24ac9","baggage":"sentry-trace_id=cf80ac8fe018495f99f53478a2596cb3,sentry-release=Unknown"},"correlation_id":"01M05RMG0NSRS5JN7G076JGYE8","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:24e3310ee378f8e39476b17cb9b23b083d7fa8777eabdf29919a23c77a17fd2d","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:12.954Z","job_size_bytes":2592,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-1dfd5d9e504491b338137f3d: done: 0.032352 sec","job_status":"done","queue_duration_s":1.182003,"scheduling_latency_s":1.182025,"redis_calls":7,"redis_duration_s":0.0024660000000000003,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001971,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000495,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020158,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032352,"completed_at":"2026-08-16T17:08:14.168Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007477,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2243gitlab # [ 443.723819] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.171Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"1ef3e0f140efb945bcb18f7f","created_at":"2026-08-16T17:08:13.702Z","trace_propagation_headers":{"sentry-trace":"e4a4ed6dce5a401b86f7038d15d31640-e011c0682d974b53","baggage":"sentry-trace_id=e4a4ed6dce5a401b86f7038d15d31640,sentry-release=Unknown"},"correlation_id":"01M05RMA9YKSWZEKT0TS5Z9HSF","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:13.709Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-1ef3e0f140efb945bcb18f7f: start","job_status":"start","queue_duration_s":0.461573,"scheduling_latency_s":0.461594}2244gitlab # [ 443.741457] nixbot[3635]: {"ts": "2026-08-16T17:08:14.339Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-4d08eaf3d052-4", "argv0": "bwrap"}2245gitlab # [ 443.743770] gitaly[923]: time="2026-08-16T17:08:13.898Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05RQ6TMHDKTK0ZRJ4W5FX89 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:08:23.164" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:13.885" grpc.time_ms=12.53 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2246gitlab # [ 443.756971] gitaly[923]: time="2026-08-16T17:08:13.925Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RQ5D88WJ91F0Z0M3TANXF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:08:13.925" grpc.time_ms=0.391 pid=923 span.kind=server system=grpc2247gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1'2248gitlab # [ 443.766486] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.285Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"1ef3e0f140efb945bcb18f7f","created_at":"2026-08-16T17:08:13.702Z","trace_propagation_headers":{"sentry-trace":"e4a4ed6dce5a401b86f7038d15d31640-e011c0682d974b53","baggage":"sentry-trace_id=e4a4ed6dce5a401b86f7038d15d31640,sentry-release=Unknown"},"correlation_id":"01M05RMA9YKSWZEKT0TS5Z9HSF","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:13.709Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-1ef3e0f140efb945bcb18f7f: done: 0.114083 sec","job_status":"done","queue_duration_s":0.461573,"scheduling_latency_s":0.461594,"redis_calls":11,"redis_duration_s":0.0033410000000000002,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000539,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002311,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000491,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.008,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.07096,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004607,"duration_s":0.114083,"completed_at":"2026-08-16T17:08:14.285Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.037165,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2249gitlab # [ 443.810926] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.287Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"58d7ff92d6430ebb610cbda2","created_at":"2026-08-16T17:08:13.866Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-159836220e1d4dc4","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:13.869Z","job_size_bytes":23,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-58d7ff92d6430ebb610cbda2: start","job_status":"start","queue_duration_s":0.418042,"scheduling_latency_s":0.418065}2250gitlab # [ 443.826411] gitaly[923]: time="2026-08-16T17:08:13.941Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ6TMHDKTK0ZRJ4W5FX89 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-16T17:08:23.220" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:08:13.940" grpc.time_ms=0.269 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2251gitlab # [ 443.836405] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.338Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"58d7ff92d6430ebb610cbda2","created_at":"2026-08-16T17:08:13.866Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-159836220e1d4dc4","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:13.869Z","job_size_bytes":23,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-58d7ff92d6430ebb610cbda2: done: 0.051871 sec","job_status":"done","queue_duration_s":0.418042,"scheduling_latency_s":0.418065,"redis_calls":7,"redis_duration_s":0.00232,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001514,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000806,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032739,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.051871,"completed_at":"2026-08-16T17:08:14.338Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01365,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2252gitlab # [ 443.878139] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.340Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"2c65aca83775d565536df3fb","created_at":"2026-08-16T17:08:14.026Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-159836220e1d4dc4","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.029Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-2c65aca83775d565536df3fb: start","job_status":"start","queue_duration_s":0.311263,"scheduling_latency_s":0.311287}2253gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.09 seconds)2254(finished: subtest: push delivers the webhook, in 89.93 seconds)2255subtest: eval and build post commit statuses2256gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1/statuses2257gitlab # [ 443.894610] gitaly[923]: time="2026-08-16T17:08:13.963Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=568 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=8 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ6TMHDKTK0ZRJ4W5FX89 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-16T17:08:23.229" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:13.949" grpc.time_ms=13.373 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2258gitlab # [ 443.907837] gitaly[923]: time="2026-08-16T17:08:13.968Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RQ5D88WJ91F0Z0M3TANXF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:08:13.967" grpc.time_ms=0.414 pid=923 span.kind=server system=grpc2259gitlab # [ 443.917593] nixbot[3635]: INFO: ::ffff:127.0.0.1:58220 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK2260gitlab # [ 443.919864] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.378Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"2c65aca83775d565536df3fb","created_at":"2026-08-16T17:08:14.026Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-159836220e1d4dc4","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.029Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-2c65aca83775d565536df3fb: done: 0.038045 sec","job_status":"done","queue_duration_s":0.311263,"scheduling_latency_s":0.311287,"redis_calls":7,"redis_duration_s":0.005018,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001285,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003733,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020472,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038045,"completed_at":"2026-08-16T17:08:14.378Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009096,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2261gitlab # [ 443.963942] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.381Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"cad7b7e67a7ff9baf3da4a76","created_at":"2026-08-16T17:08:14.037Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-159836220e1d4dc4","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.043Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-cad7b7e67a7ff9baf3da4a76: start","job_status":"start","queue_duration_s":0.337956,"scheduling_latency_s":0.337982}2262gitlab # [ 443.981087] nix-daemon[3858]: accepted connection from pid 4514, user nixbot2263gitlab # [ 443.982096] nix-daemon[3858]: accepted connection from pid 4526, user nixbot2264gitlab # [ 443.983080] gitaly[923]: time="2026-08-16T17:08:14.007Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RQ5D88WJ91F0Z0M3TANXF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:08:14.002" grpc.time_ms=4.999 pid=923 span.kind=server system=grpc2265gitlab # [ 443.993081] gitaly[923]: time="2026-08-16T17:08:14.013Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RQ6TMHDKTK0ZRJ4W5FX89 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:08:14.007" grpc.time_ms=2.874 pid=923 span.kind=server system=grpc2266gitlab # [ 444.002841] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.422Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"cad7b7e67a7ff9baf3da4a76","created_at":"2026-08-16T17:08:14.037Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-159836220e1d4dc4","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.043Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-cad7b7e67a7ff9baf3da4a76: done: 0.041056 sec","job_status":"done","queue_duration_s":0.337956,"scheduling_latency_s":0.337982,"redis_calls":7,"redis_duration_s":0.001857,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001382,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000475,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026291,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.041056,"completed_at":"2026-08-16T17:08:14.422Z","load_balancing_strategy":"primary","db_duration_s":0.009513,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2267gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1/statuses, in 0.16 seconds)2268gitlab # [ 444.045175] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.424Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"8344dc7c4f57550b247511bf","created_at":"2026-08-16T17:08:14.051Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-159836220e1d4dc4","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.054Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-8344dc7c4f57550b247511bf: start","job_status":"start","queue_duration_s":0.369966,"scheduling_latency_s":0.369989}2269gitlab # [ 444.062463] gitaly[923]: time="2026-08-16T17:08:14.019Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ5D88WJ91F0Z0M3TANXF diskcache=39b028f3-361f-4978-b9b6-684225805f29 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:08:43.575" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:13.876" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2270gitlab # [ 444.072590] gitaly[923]: time="2026-08-16T17:08:14.020Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=132 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7292 command.oublock=0 command.real_time_ms=133 command.spawn_token_fork_ms=0 command.system_time_ms=68 command.user_time_ms=64 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ5D88WJ91F0Z0M3TANXF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:08:43.575" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:13.876" grpc.time_ms=143.749 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2271gitlab # [ 444.086519] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.469Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"8344dc7c4f57550b247511bf","created_at":"2026-08-16T17:08:14.051Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-159836220e1d4dc4","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.054Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-8344dc7c4f57550b247511bf: done: 0.044709 sec","job_status":"done","queue_duration_s":0.369966,"scheduling_latency_s":0.369989,"redis_calls":10,"redis_duration_s":0.002799,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001339,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000937,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000523,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028125,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.044709,"completed_at":"2026-08-16T17:08:14.469Z","load_balancing_strategy":"primary","db_duration_s":0.011119,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2272gitlab # [ 444.131018] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.470Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"6c214ff90cb88c03761a174a","created_at":"2026-08-16T17:08:14.055Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-159836220e1d4dc4","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.058Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-6c214ff90cb88c03761a174a: start","job_status":"start","queue_duration_s":0.41247,"scheduling_latency_s":0.41249}2273gitlab # [ 444.148096] nix-daemon[3858]: accepted connection from pid 4540, user nixbot2274gitlab # [ 444.149011] nix-daemon[3858]: accepted connection from pid 4514, user nixbot2275gitlab # [ 444.150360] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:08:14 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1222276gitlab # [ 444.153007] gitaly[923]: time="2026-08-16T17:08:14.043Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RQ6TMHDKTK0ZRJ4W5FX89 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4156 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:08:14.043" grpc.time_ms=0.402 pid=923 span.kind=server system=grpc2277gitlab # [ 444.162596] gitaly[923]: time="2026-08-16T17:08:14.054Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ6TMHDKTK0ZRJ4W5FX89 diskcache=ef430ca3-89e8-41c6-a3f9-fc7d4af8ef7c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T17:08:23.246" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:08:13.967" pid=923 ref=refs/keep-around/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 remote_ip="2001:db8:1::1" revision=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 span.kind=server system=grpc username=root2278gitlab # [ 444.174380] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.519Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"6c214ff90cb88c03761a174a","created_at":"2026-08-16T17:08:14.055Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-159836220e1d4dc4","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.058Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-6c214ff90cb88c03761a174a: done: 0.048439 sec","job_status":"done","queue_duration_s":0.41247,"scheduling_latency_s":0.41249,"redis_calls":7,"redis_duration_s":0.002651,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001802,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000849,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037459,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.048439,"completed_at":"2026-08-16T17:08:14.519Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00526,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2279gitlab # [ 444.218503] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.522Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"065a4d2d068d4b6996cfc4a4","created_at":"2026-08-16T17:08:14.059Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-159836220e1d4dc4","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.061Z","job_size_bytes":19,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-065a4d2d068d4b6996cfc4a4: start","job_status":"start","queue_duration_s":0.460983,"scheduling_latency_s":0.461029}2280gitlab # [ 444.267293] gitaly[923]: time="2026-08-16T17:08:14.054Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=74 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5248 command.oublock=8 command.real_time_ms=80 command.spawn_token_fork_ms=2 command.system_time_ms=44 command.user_time_ms=30 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ6TMHDKTK0ZRJ4W5FX89 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T17:08:23.246" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:08:13.967" grpc.time_ms=87.092 pid=923 ref=refs/keep-around/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 remote_ip="2001:db8:1::1" revision=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 span.kind=server system=grpc username=root2281gitlab # [ 444.303608] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.575Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"065a4d2d068d4b6996cfc4a4","created_at":"2026-08-16T17:08:14.059Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-159836220e1d4dc4","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.061Z","job_size_bytes":19,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-065a4d2d068d4b6996cfc4a4: done: 0.053311 sec","job_status":"done","queue_duration_s":0.460983,"scheduling_latency_s":0.461029,"redis_calls":8,"redis_duration_s":0.00266,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002102,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000558,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034142,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.053311,"completed_at":"2026-08-16T17:08:14.575Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00528,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2282gitlab # [ 444.361396] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.577Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"991d881b5e195fec67bfc756","created_at":"2026-08-16T17:08:14.062Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-159836220e1d4dc4","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.064Z","job_size_bytes":66,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-991d881b5e195fec67bfc756: start","job_status":"start","queue_duration_s":0.513274,"scheduling_latency_s":0.513302}2283gitlab # [ 444.379564] gitaly[923]: time="2026-08-16T17:08:14.058Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ6TMHDKTK0ZRJ4W5FX89 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:08:44.057" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:14.058" grpc.time_ms=0.495 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2284gitlab # [ 444.392494] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.616Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"991d881b5e195fec67bfc756","created_at":"2026-08-16T17:08:14.062Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-159836220e1d4dc4","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.064Z","job_size_bytes":66,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-991d881b5e195fec67bfc756: done: 0.038673 sec","job_status":"done","queue_duration_s":0.513274,"scheduling_latency_s":0.513302,"redis_calls":7,"redis_duration_s":0.001761,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001228,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000533,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023551,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038673,"completed_at":"2026-08-16T17:08:14.616Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007893,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2285gitlab # [ 444.436603] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.618Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"c2d27ab083f1aaa136a8287e","created_at":"2026-08-16T17:08:14.065Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-159836220e1d4dc4","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.066Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-c2d27ab083f1aaa136a8287e: start","job_status":"start","queue_duration_s":0.551623,"scheduling_latency_s":0.551648}2286gitlab # [ 444.452837] gitaly[923]: time="2026-08-16T17:08:14.082Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RQ5D88WJ91F0Z0M3TANXF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T17:08:44.081" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:14.081" grpc.time_ms=0.746 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2287gitlab # [ 444.465162] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.653Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"c2d27ab083f1aaa136a8287e","created_at":"2026-08-16T17:08:14.065Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-159836220e1d4dc4","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.066Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-c2d27ab083f1aaa136a8287e: done: 0.035101 sec","job_status":"done","queue_duration_s":0.551623,"scheduling_latency_s":0.551648,"redis_calls":7,"redis_duration_s":0.001478,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001094,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000384,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022427,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.035101,"completed_at":"2026-08-16T17:08:14.653Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006771,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2288gitlab # [ 444.508089] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.655Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"27dc89857bd08e384d517c76","created_at":"2026-08-16T17:08:14.067Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-159836220e1d4dc4","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.068Z","job_size_bytes":6,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-27dc89857bd08e384d517c76: start","job_status":"start","queue_duration_s":0.586649,"scheduling_latency_s":0.586673}2289gitlab # [ 444.523693] gitaly[923]: time="2026-08-16T17:08:14.118Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ5D88WJ91F0Z0M3TANXF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:08:44.117" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:14.117" grpc.time_ms=0.845 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2290gitlab # [ 444.535856] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.678Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"27dc89857bd08e384d517c76","created_at":"2026-08-16T17:08:14.067Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-159836220e1d4dc4","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.068Z","job_size_bytes":6,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-27dc89857bd08e384d517c76: done: 0.023002 sec","job_status":"done","queue_duration_s":0.586649,"scheduling_latency_s":0.586673,"redis_calls":7,"redis_duration_s":0.005855,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004686,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001169,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012466,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023002,"completed_at":"2026-08-16T17:08:14.678Z","load_balancing_strategy":"primary","db_duration_s":0.000412,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2291gitlab # [ 444.576963] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.679Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"3ede9258755e9bd780380f3e","created_at":"2026-08-16T17:08:14.063Z","trace_propagation_headers":{"sentry-trace":"e4205a2a16474f09bf7e9d004532b7f4-3c491c18a78f4370","baggage":"sentry-trace_id=e4205a2a16474f09bf7e9d004532b7f4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RQ6TMHDKTK0ZRJ4W5FX89","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.068Z","job_size_bytes":65,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-3ede9258755e9bd780380f3e: start","job_status":"start","queue_duration_s":0.611238,"scheduling_latency_s":0.611264}2292gitlab # [ 444.593358] gitaly[923]: time="2026-08-16T17:08:14.676Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ7M4ECQRGC3KQTZW8Y6T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:08:44.475" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:14.676" grpc.time_ms=0.645 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2293gitlab # [ 444.605660] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.711Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"3ede9258755e9bd780380f3e","created_at":"2026-08-16T17:08:14.063Z","trace_propagation_headers":{"sentry-trace":"e4205a2a16474f09bf7e9d004532b7f4-3c491c18a78f4370","baggage":"sentry-trace_id=e4205a2a16474f09bf7e9d004532b7f4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RQ6TMHDKTK0ZRJ4W5FX89","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.068Z","job_size_bytes":65,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-3ede9258755e9bd780380f3e: done: 0.031859 sec","job_status":"done","queue_duration_s":0.611238,"scheduling_latency_s":0.611264,"redis_calls":7,"redis_duration_s":0.001201,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000818,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000383,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022591,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031859,"completed_at":"2026-08-16T17:08:14.711Z","load_balancing_strategy":"primary","db_duration_s":0.004718,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2294gitlab # [ 444.647443] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.713Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"9ef025a683f24c0cddc90a62","created_at":"2026-08-16T17:08:14.069Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-159836220e1d4dc4","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.070Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-9ef025a683f24c0cddc90a62: start","job_status":"start","queue_duration_s":0.642439,"scheduling_latency_s":0.642466}2295gitlab # [ 444.662495] gitaly[923]: time="2026-08-16T17:08:14.916Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RQ6TMHDKTK0ZRJ4W5FX89 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T17:08:44.614" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:14.914" grpc.time_ms=1.352 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2296gitlab # [ 444.675101] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.737Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"9ef025a683f24c0cddc90a62","created_at":"2026-08-16T17:08:14.069Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-159836220e1d4dc4","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.070Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-9ef025a683f24c0cddc90a62: done: 0.024873 sec","job_status":"done","queue_duration_s":0.642439,"scheduling_latency_s":0.642466,"redis_calls":7,"redis_duration_s":0.001183,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000888,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000295,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017344,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024873,"completed_at":"2026-08-16T17:08:14.737Z","load_balancing_strategy":"primary","db_duration_s":0.003049,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2297gitlab # [ 444.716977] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.742Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"6eabcf1b49086ef98e3eeaae","created_at":"2026-08-16T17:08:14.069Z","trace_propagation_headers":{"sentry-trace":"e4205a2a16474f09bf7e9d004532b7f4-3c491c18a78f4370","baggage":"sentry-trace_id=e4205a2a16474f09bf7e9d004532b7f4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RQ6TMHDKTK0ZRJ4W5FX89","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.073Z","job_size_bytes":65,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-6eabcf1b49086ef98e3eeaae: start","job_status":"start","queue_duration_s":0.668574,"scheduling_latency_s":0.668601}2298gitlab # [ 444.734219] gitaly[923]: time="2026-08-16T17:08:14.964Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ6TMHDKTK0ZRJ4W5FX89 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:08:44.662" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:14.963" grpc.time_ms=1.522 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2299gitlab # [ 444.746411] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.801Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"6eabcf1b49086ef98e3eeaae","created_at":"2026-08-16T17:08:14.069Z","trace_propagation_headers":{"sentry-trace":"e4205a2a16474f09bf7e9d004532b7f4-3c491c18a78f4370","baggage":"sentry-trace_id=e4205a2a16474f09bf7e9d004532b7f4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RQ6TMHDKTK0ZRJ4W5FX89","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.073Z","job_size_bytes":65,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-6eabcf1b49086ef98e3eeaae: done: 0.059478 sec","job_status":"done","queue_duration_s":0.668574,"scheduling_latency_s":0.668601,"redis_calls":10,"redis_duration_s":0.001968,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000948,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.00102,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041301,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.059478,"completed_at":"2026-08-16T17:08:14.801Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013003,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2300gitlab # [ 444.789920] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.803Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"70cf151e3782761f093f8da5","created_at":"2026-08-16T17:08:14.128Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-159836220e1d4dc4","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.130Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-70cf151e3782761f093f8da5: start","job_status":"start","queue_duration_s":0.673006,"scheduling_latency_s":0.673025}2301gitlab # [ 444.805414] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.831Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"70cf151e3782761f093f8da5","created_at":"2026-08-16T17:08:14.128Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-159836220e1d4dc4","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.130Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-70cf151e3782761f093f8da5: done: 0.028649 sec","job_status":"done","queue_duration_s":0.673006,"scheduling_latency_s":0.673025,"redis_calls":8,"redis_duration_s":0.001747,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001356,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000391,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019167,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028649,"completed_at":"2026-08-16T17:08:14.831Z","load_balancing_strategy":"primary","db_duration_s":0.004863,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2302gitlab # [ 444.846704] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.833Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"95290fcb1cdd92c84edc78fb","created_at":"2026-08-16T17:08:14.146Z","trace_propagation_headers":{"sentry-trace":"e4205a2a16474f09bf7e9d004532b7f4-3c491c18a78f4370","baggage":"sentry-trace_id=e4205a2a16474f09bf7e9d004532b7f4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RQ6TMHDKTK0ZRJ4W5FX89","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.149Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-95290fcb1cdd92c84edc78fb: start","job_status":"start","queue_duration_s":0.683251,"scheduling_latency_s":0.683269}2303gitlab # [ 444.862408] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.976Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"95290fcb1cdd92c84edc78fb","created_at":"2026-08-16T17:08:14.146Z","trace_propagation_headers":{"sentry-trace":"e4205a2a16474f09bf7e9d004532b7f4-3c491c18a78f4370","baggage":"sentry-trace_id=e4205a2a16474f09bf7e9d004532b7f4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RQ6TMHDKTK0ZRJ4W5FX89","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.149Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-95290fcb1cdd92c84edc78fb: done: 0.143295 sec","job_status":"done","queue_duration_s":0.683251,"scheduling_latency_s":0.683269,"gitaly_calls":2,"gitaly_duration_s":0.008022,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.008256,"redis_read_bytes":79,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.00142,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001169,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000319,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001903,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.00035,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000613,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001062,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.04,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.004,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.006,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.017,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.092245,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.11056952,"duration_s":0.143295,"completed_at":"2026-08-16T17:08:14.976Z","load_balancing_strategy":"primary","db_duration_s":0.043133,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2304gitlab # [ 444.914029] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.977Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"9a923174d4848631a6c6efef","created_at":"2026-08-16T17:08:14.896Z","trace_propagation_headers":{"sentry-trace":"e4205a2a16474f09bf7e9d004532b7f4-d78cdf31f06a4f89","baggage":"sentry-trace_id=e4205a2a16474f09bf7e9d004532b7f4,sentry-release=Unknown"},"correlation_id":"01M05RQ6TMHDKTK0ZRJ4W5FX89","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.898Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-9a923174d4848631a6c6efef: start","job_status":"start","queue_duration_s":0.07941,"scheduling_latency_s":0.079427}2305gitlab # [ 444.929962] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:15.015Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"9a923174d4848631a6c6efef","created_at":"2026-08-16T17:08:14.896Z","trace_propagation_headers":{"sentry-trace":"e4205a2a16474f09bf7e9d004532b7f4-d78cdf31f06a4f89","baggage":"sentry-trace_id=e4205a2a16474f09bf7e9d004532b7f4,sentry-release=Unknown"},"correlation_id":"01M05RQ6TMHDKTK0ZRJ4W5FX89","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.898Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-9a923174d4848631a6c6efef: done: 0.037271 sec","job_status":"done","queue_duration_s":0.07941,"scheduling_latency_s":0.079427,"redis_calls":7,"redis_duration_s":0.0019459999999999998,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001377,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000569,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024935,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037271,"completed_at":"2026-08-16T17:08:15.015Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008051,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2306gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1/statuses2307gitlab # [ 445.254123] gitaly[923]: time="2026-08-16T17:08:15.918Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ8T4VDWCMSS8N42VCVXF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:08:45.016" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:15.917" grpc.time_ms=1.338 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2308gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1/statuses, in 0.25 seconds)2309gitlab # [ 445.310128] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:08:15 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1622310gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1/statuses2311gitlab # [ 446.488736] gitaly[923]: time="2026-08-16T17:08:17.153Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQA0BGFVVWBMMY08JB3MA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:08:47.151" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:17.152" grpc.time_ms=1.256 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2312gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1/statuses, in 0.24 seconds)2313gitlab # [ 446.554453] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:08:17 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1832314gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1/statuses2315gitlab # [ 447.704148] gitaly[923]: time="2026-08-16T17:08:18.368Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQB72VRYF5SBWDCJF1BJV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:08:48.366" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:18.367" grpc.time_ms=1.425 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2316gitlab # [ 447.751936] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:08:18 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1422317gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1/statuses, in 0.20 seconds)2318gitlab # [ 448.640495] gitaly[923]: time="2026-08-16T17:08:19.306Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQC3ST7K61XFWATCC2J0R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:08:49.303" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:19.304" grpc.time_ms=1.407 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2319gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1/statuses2320gitlab # [ 448.742370] gitaly[923]: time="2026-08-16T17:08:19.407Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RQC3ST7K61XFWATCC2J0R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:08:29.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:19.387" grpc.time_ms=19.731 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2321gitlab # [ 448.838056] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:19.501Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"b5d60fa253f19d1916354f78","created_at":"2026-08-16T17:08:19.490Z","trace_propagation_headers":{"sentry-trace":"a29b06fdc69d469fbe3dcba7336611e1-0df0fa651d564429","baggage":"sentry-trace_id=a29b06fdc69d469fbe3dcba7336611e1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RQC3ST7K61XFWATCC2J0R","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:19.497Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-b5d60fa253f19d1916354f78: start","job_status":"start","queue_duration_s":0.00305,"scheduling_latency_s":0.003123}2322gitlab # [ 448.883751] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:08:19 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 3422323gitlab # [ 448.890465] nixbot[3635]: {"ts": "2026-08-16T17:08:19.540Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 \"HTTP/1.1 201 Created\""}2324gitlab # [ 448.896271] gitaly[923]: time="2026-08-16T17:08:19.551Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQCCKQ8K03G59QGD0XR2H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:08:49.350" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:19.550" grpc.time_ms=0.886 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2325gitlab # [ 448.926042] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:08:19 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1/statuses HTTP/1.1" 200 671 "" "curl/8.21.0" 1162326gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1/statuses, in 0.18 seconds)2327gitlab # [ 448.996909] gitaly[923]: time="2026-08-16T17:08:19.662Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQCF2R9MJC9ZDHB6ZVGZZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:08:49.660" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:19.661" grpc.time_ms=1.246 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2328gitlab # [ 449.076345] gitaly[923]: time="2026-08-16T17:08:19.742Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M05RQCF2R9MJC9ZDHB6ZVGZZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:08:29.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:19.722" grpc.time_ms=19.358 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2329gitlab # [ 449.188348] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:08:19 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2962330gitlab # [ 449.191396] nixbot[3635]: {"ts": "2026-08-16T17:08:19.852Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 \"HTTP/1.1 201 Created\""}2331gitlab # [ 449.256171] gitaly[923]: time="2026-08-16T17:08:19.922Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RQC3ST7K61XFWATCC2J0R grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:08:19.920" grpc.time_ms=1.602 pid=923 span.kind=server system=grpc2332gitlab # [ 449.304664] gitaly[923]: time="2026-08-16T17:08:19.970Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RQC3ST7K61XFWATCC2J0R grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:08:19.969" grpc.time_ms=1.333 pid=923 span.kind=server system=grpc2333gitlab # [ 449.326056] gitaly[923]: time="2026-08-16T17:08:19.985Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQCS3D1Z0J180C162HCNR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:08:49.083" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:19.984" grpc.time_ms=1.005 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2334gitlab # [ 449.358432] gitaly[923]: time="2026-08-16T17:08:20.024Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RQC3ST7K61XFWATCC2J0R grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:08:20.023" grpc.time_ms=0.638 pid=923 span.kind=server system=grpc2335gitlab # [ 449.375847] gitaly[923]: time="2026-08-16T17:08:20.037Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M05RQC3ST7K61XFWATCC2J0R forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:08:49.571" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:19.872" operations="[repack_refs]" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2336gitlab # [ 449.394531] gitaly[923]: time="2026-08-16T17:08:20.041Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M05RQC3ST7K61XFWATCC2J0R grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:08:49.571" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:19.872" pid=923 remote_ip="2001:db8:1::1" repository_info="{false {6 701 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-08-16 17:06:35.55614392 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2337gitlab # [ 449.409269] gitaly[923]: time="2026-08-16T17:08:20.047Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05RQC3ST7K61XFWATCC2J0R diskcache=a5ec4f81-ab37-495b-85d4-b7486a9b98ef grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:08:49.571" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:19.872" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2338gitlab # [ 449.419803] gitaly[923]: time="2026-08-16T17:08:20.047Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=124 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7169 command.oublock=0 command.real_time_ms=162 command.spawn_token_fork_ms=2 command.system_time_ms=81 command.user_time_ms=43 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQC3ST7K61XFWATCC2J0R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:08:49.571" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:19.872" grpc.time_ms=175.228 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2339gitlab # [ 449.433056] gitaly[923]: time="2026-08-16T17:08:20.056Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01M05RQCS3D1Z0J180C162HCNR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:08:30.022" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:20.042" grpc.time_ms=14.06 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2340gitlab # [ 449.447183] gitaly[923]: time="2026-08-16T17:08:20.071Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M05RQC3ST7K61XFWATCC2J0R grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:08:49.571" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:19.872" pid=923 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2341gitlab # [ 449.460592] gitaly[923]: time="2026-08-16T17:08:20.071Z" level=info msg="optimized repository" clean_stale_data_time=29.39546ms clean_work_trees_time="155.94µs" commit_graph_time=740ns correlation_id=01M05RQC3ST7K61XFWATCC2J0R gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="1.62µs" pid=923 prune_time=260ns relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="1.48µs" storage_name=default system=housekeeping total_time=29.60994ms2342gitlab # [ 449.466161] gitaly[923]: time="2026-08-16T17:08:20.071Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M05RQC3ST7K61XFWATCC2J0R grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:08:49.571" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:19.872" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2343gitlab # [ 449.475446] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:08:20 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2562344gitlab # [ 449.478081] nixbot[3635]: {"ts": "2026-08-16T17:08:20.133Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 \"HTTP/1.1 201 Created\""}2345gitlab # [ 449.572591] nix-daemon[3858]: accepted connection from pid 4622, user nixbot2346gitlab # [ 449.599252] gitaly[923]: time="2026-08-16T17:08:20.265Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RQC3ST7K61XFWATCC2J0R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T17:08:50.263" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:20.263" grpc.time_ms=1.288 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2347gitlab # [ 449.671683] gitaly[923]: time="2026-08-16T17:08:20.337Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQC3ST7K61XFWATCC2J0R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:08:50.035" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:20.336" grpc.time_ms=0.969 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2348gitlab # [ 449.714442] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:20.379Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"659c72f32613cfcff4886959","created_at":"2026-08-16T17:08:20.369Z","trace_propagation_headers":{"sentry-trace":"a29b06fdc69d469fbe3dcba7336611e1-5f2ce446a2434b3d","baggage":"sentry-trace_id=a29b06fdc69d469fbe3dcba7336611e1,sentry-release=Unknown"},"correlation_id":"01M05RQC3ST7K61XFWATCC2J0R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"b5d60fa253f19d1916354f78","job_size_bytes":3,"pid":3532,"job_status":"deduplicated","message":"PipelineProcessWorker JID-659c72f32613cfcff4886959: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2349gitlab # [ 449.742998] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:20.386Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"b5d60fa253f19d1916354f78","created_at":"2026-08-16T17:08:19.490Z","trace_propagation_headers":{"sentry-trace":"a29b06fdc69d469fbe3dcba7336611e1-0df0fa651d564429","baggage":"sentry-trace_id=a29b06fdc69d469fbe3dcba7336611e1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RQC3ST7K61XFWATCC2J0R","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:19.497Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3532,"job_status":"rescheduled","message":"PipelineProcessWorker JID-b5d60fa253f19d1916354f78: rescheduled"}2350gitlab # [ 449.763965] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:08:20 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 692351gitlab # [ 449.767000] gitaly[923]: time="2026-08-16T17:08:20.385Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05RQD6W1G54ZBS13DQK8MQ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:08:20.374" grpc.time_ms=10.961 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc2352gitlab # [ 449.782618] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:20.416Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"b5d60fa253f19d1916354f78","created_at":"2026-08-16T17:08:19.490Z","trace_propagation_headers":{"sentry-trace":"a29b06fdc69d469fbe3dcba7336611e1-0df0fa651d564429","baggage":"sentry-trace_id=a29b06fdc69d469fbe3dcba7336611e1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RQC3ST7K61XFWATCC2J0R","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:19.497Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-b5d60fa253f19d1916354f78: done: 0.915293 sec","job_status":"done","queue_duration_s":0.00305,"scheduling_latency_s":0.003123,"gitaly_calls":3,"gitaly_duration_s":0.205014,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.09288,"redis_read_bytes":247,"redis_write_bytes":21779,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001725,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.002597,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.043326,"redis_queues_read_bytes":36,"redis_queues_write_bytes":14464,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.035098,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.001969,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001285,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.005155,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":34,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":34,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.173,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":17,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.014,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.017,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.072,"db_ci_duration_s":0.101,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.418956,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.7566695,"duration_s":0.915293,"completed_at":"2026-08-16T17:08:20.416Z","load_balancing_strategy":"primary","db_duration_s":0.176552,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2353gitlab # [ 449.835507] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:20.418Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"43762e2ad52be8775d2055e1","created_at":"2026-08-16T17:08:19.851Z","trace_propagation_headers":{"sentry-trace":"a29b06fdc69d469fbe3dcba7336611e1-5f2ce446a2434b3d","baggage":"sentry-trace_id=a29b06fdc69d469fbe3dcba7336611e1,sentry-release=Unknown"},"correlation_id":"01M05RQC3ST7K61XFWATCC2J0R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:19.858Z","job_size_bytes":23,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-43762e2ad52be8775d2055e1: start","job_status":"start","queue_duration_s":0.560075,"scheduling_latency_s":0.560106}2354gitlab # [ 449.852161] gitaly[923]: time="2026-08-16T17:08:20.500Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05RQD9491R25W94PGVM0R82 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:08:20.485" pid=923 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2355gitlab # [ 449.861854] gitlab-workhorse[825]: time="2026-08-16T17:08:20Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672356gitlab # [ 449.863601] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:08:20 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1132357gitlab # [ 449.865606] gitaly[923]: time="2026-08-16T17:08:20.501Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQD9491R25W94PGVM0R82 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:08:20.485" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc2358gitlab # [ 449.878937] gitaly[923]: time="2026-08-16T17:08:20.502Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQD9491R25W94PGVM0R82 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:08:20.485" grpc.time_ms=15.849 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc2359gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1/statuses2360gitlab # [ 449.978055] nix-daemon[3858]: accepted connection from pid 4647, user nixbot2361gitlab # [ 449.999964] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:20.664Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"43762e2ad52be8775d2055e1","created_at":"2026-08-16T17:08:19.851Z","trace_propagation_headers":{"sentry-trace":"a29b06fdc69d469fbe3dcba7336611e1-5f2ce446a2434b3d","baggage":"sentry-trace_id=a29b06fdc69d469fbe3dcba7336611e1,sentry-release=Unknown"},"correlation_id":"01M05RQC3ST7K61XFWATCC2J0R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:19.858Z","job_size_bytes":23,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-43762e2ad52be8775d2055e1: done: 0.246275 sec","job_status":"done","queue_duration_s":0.560075,"scheduling_latency_s":0.560106,"redis_calls":7,"redis_duration_s":0.014061,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.010817,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003244,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.113,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.078,"db_ci_duration_s":0.036,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0815,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.246275,"completed_at":"2026-08-16T17:08:20.664Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.113113,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2362gitlab # [ 450.081821] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:20.666Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"4a327560e134b8a6db44400b","created_at":"2026-08-16T17:08:19.824Z","trace_propagation_headers":{"sentry-trace":"32d9ebaaf27a442880437dab01dd0b6f-b02139a26a8d4a04","baggage":"sentry-trace_id=32d9ebaaf27a442880437dab01dd0b6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d3c03113e46622c5f7bb3b8100daf8d8","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:19.898Z","job_size_bytes":2,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-4a327560e134b8a6db44400b: start","job_status":"start","queue_duration_s":0.767266,"scheduling_latency_s":0.767332}2363gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1/statuses, in 0.19 seconds)2364(finished: subtest: eval and build post commit statuses, in 6.23 seconds)2365(finished: run the VM test script, in 525.09 seconds)2366gitlab # [ 450.098972] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:20.699Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"4a327560e134b8a6db44400b","created_at":"2026-08-16T17:08:19.824Z","trace_propagation_headers":{"sentry-trace":"32d9ebaaf27a442880437dab01dd0b6f-b02139a26a8d4a04","baggage":"sentry-trace_id=32d9ebaaf27a442880437dab01dd0b6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d3c03113e46622c5f7bb3b8100daf8d8","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:19.898Z","job_size_bytes":2,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-4a327560e134b8a6db44400b: done: 0.032926 sec","job_status":"done","queue_duration_s":0.767266,"scheduling_latency_s":0.767332,"redis_calls":9,"redis_duration_s":0.0017109999999999998,"redis_read_bytes":7,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000323,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001003,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000385,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020788,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032926,"completed_at":"2026-08-16T17:08:20.699Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004702,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2367gitlab # [ 450.142146] gitaly[923]: time="2026-08-16T17:08:20.734Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQDHNFM5N9XG6VH14ST2E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:08:50.533" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:20.733" grpc.time_ms=0.983 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2368gitlab # [ 450.157036] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:08:20 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1/statuses HTTP/1.1" 200 1328 "" "curl/8.21.0" 1252369test script finished in 525.13s2370cleanup2371kill QemuMachine (pid 46)2372gitlab # [ 450.160861] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:20.700Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"17483584dbe971f5024d930d","created_at":"2026-08-16T17:08:19.908Z","trace_propagation_headers":{"sentry-trace":"32d9ebaaf27a442880437dab01dd0b6f-b02139a26a8d4a04","baggage":"sentry-trace_id=32d9ebaaf27a442880437dab01dd0b6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d401cdd8537946c05c599e96096ae933","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:19.919Zqemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/41m77i1296n33p6liin8ynr6wh3h6b7m-python3-3.14.6/bin/python3.14)2373(finished: cleanup, in 1.50 seconds)2374additionally exposed symbols:2375 gitlab,2376 vlan1,2377 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2378[]2379[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-08-16T17:06:43.620Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2380[]2381[]2382[]2383[]2384[]2385[]2386[]2387[]2388[]2389[]2390[]2391[]2392[]2393[]2394[]2395[]2396[]2397[]2398[]2399[]2400[]2401[]2402[]2403[]2404[]2405[]2406[]2407[]2408[]2409[]2410[]2411[]2412[]2413[]2414[]2415[]2416[]2417[]2418[]2419[]2420[]2421[]2422[]2423[]2424[]2425[]2426[]2427[]2428[]2429[]2430[]2431[]2432[]2433[]2434[]2435[]2436[]2437[]2438[]2439[]2440[]2441[]2442[]2443[]2444[]2445[]2446[]2447[]2448[]2449[]2450[]2451[]2452[]2453[]2454[]2455[]2456[]2457[]2458[]2459[]2460[]2461[]2462[]2463[]2464[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-08-16T17:08:13.764506Z', 'started_at': '2026-08-16T17:08:14.173085Z', 'finished_at': None}]2465[{'id': 5, 'sha': '4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-16T17:08:14.138Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2466[{'id': 5, 'sha': '4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-16T17:08:14.138Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2467[{'id': 5, 'sha': '4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-16T17:08:14.138Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2468[{'id': 5, 'sha': '4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-16T17:08:14.138Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2469[{'id': 5, 'sha': '4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-08-16T17:08:14.138Z', 'started_at': None, 'finished_at': '2026-08-16T17:08:19.466Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2470[{'id': 5, 'sha': '4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-08-16T17:08:14.138Z', 'started_at': None, 'finished_at': '2026-08-16T17:08:19.466Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '0 attributes built', 'created_at': '2026-08-16T17:08:19.796Z', 'started_at': None, 'finished_at': '2026-08-16T17:08:20.094Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]