vm-test-run-nixbot-gitlab
default.checks.aarch64-linux.nixbot-gitlab
· build #210
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 46)10gitlab # Disk image does not exist, creating the virtualisation disk image...11gitlab # Formatting '/build/vm-state-gitlab/tmp.1rcuIhT3OE', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13(finished: start all VMs, in 69.04 seconds)14gitlab # Discarding device blocks: 0/262144 done15gitlab: waiting for unit setup-gitlab.service16gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes17gitlab: waiting for the VM to finish booting18gitlab # Filesystem UUID: 5f0618aa-dd81-437c-b88d-2dd447fb5c1119gitlab # Superblock backups stored on blocks:20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]31gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Thu Aug 6 17:27:09 UTC 202632gitlab # [ 0.000000] KASLR enabled33gitlab # [ 0.000000] random: crng init done34gitlab # [ 0.000000] Machine model: linux,dummy-virt35gitlab # [ 0.000000] efi: UEFI not found.36gitlab # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT37gitlab # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff]38gitlab # [ 0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf]39gitlab # [ 0.000000] Zone ranges:40gitlab # [ 0.000000] DMA [mem 0x0000000040000000-0x00000000ffffffff]41gitlab # [ 0.000000] DMA32 empty42gitlab # [ 0.000000] Normal [mem 0x0000000100000000-0x00000001bfffffff]43gitlab # [ 0.000000] Device empty44gitlab # [ 0.000000] Movable zone start for each node45gitlab # [ 0.000000] Early memory node ranges46gitlab # [ 0.000000] node 0: [mem 0x0000000040000000-0x00000001bfffffff]47gitlab # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff]48gitlab # [ 0.000000] cma: Reserved 32 MiB at 0x00000000fe00000049gitlab # [ 0.000000] psci: probing for conduit method from DT.50gitlab # [ 0.000000] psci: PSCIv1.3 detected in firmware.51gitlab # [ 0.000000] psci: Using standard PSCI v0.2 function IDs52gitlab # [ 0.000000] psci: Trusted OS migration not required53gitlab # [ 0.000000] psci: SMC Calling Convention v1.154gitlab # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)55gitlab # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u31129656gitlab # [ 0.000000] Detected PIPT I-cache on CPU057gitlab # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)58gitlab # [ 0.000000] CPU features: detected: GICv3 CPU interface59gitlab # [ 0.000000] CPU features: detected: Spectre-v460gitlab # [ 0.000000] CPU features: detected: Spectre-BHB61gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_3862gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_2363gitlab # [ 0.000000] alternatives: applying boot alternatives64gitlab # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/v80z2zwr7jql61jinm2n0mzb8j0aw04f-nixos-system-gitlab-test/init regInfo=/nix/store/k4dh2livdvfb2jxsfc8x1lama36gdsyr-closure-info/registration console=ttyAMA0,115200n8 console=tty065gitlab # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/k4dh2livdvfb2jxsfc8x1lama36gdsyr-closure-info/registration", will be passed to user space.66gitlab # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes67gitlab # [ 0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)68gitlab # [ 0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)69gitlab # [ 0.000000] software IO TLB: area num 4.70gitlab # [ 0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB)71gitlab # [ 0.000000] Fallback order for Node 0: 072gitlab # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 157286473gitlab # [ 0.000000] Policy zone: Normal74gitlab # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off75gitlab # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=176gitlab # [ 0.000000] allocated 12582912 bytes of page_ext77gitlab # [ 0.000000] ftrace: allocating 74867 entries in 294 pages78gitlab # [ 0.000000] ftrace: allocated 294 pages with 4 groups79gitlab # [ 0.000000] rcu: Hierarchical RCU implementation.80gitlab # [ 0.000000] rcu: RCU event tracing is enabled.81gitlab # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.82gitlab # [ 0.000000] Trampoline variant of Tasks RCU enabled.83gitlab # [ 0.000000] Rude variant of Tasks RCU enabled.84gitlab # [ 0.000000] Tracing variant of Tasks RCU enabled.85gitlab # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.86gitlab # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=487gitlab # [ 0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.88gitlab # [ 0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.89gitlab # [ 0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.90gitlab # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 091gitlab # [ 0.000000] GICv3: 256 SPIs implemented92gitlab # [ 0.000000] GICv3: 0 Extended SPIs implemented93gitlab # [ 0.000000] Root IRQ handler: gic_handle_irq94gitlab # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI95gitlab # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=096gitlab # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a000097gitlab # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]98gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f10000 (indirect, esz 8, psz 64K, shr 1)99gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f20000 (flat, esz 8, psz 64K, shr 1)100gitlab # [ 0.000000] GICv3: using LPI property table @0x0000000100f30000101gitlab # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f40000102gitlab # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.103gitlab # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns104gitlab # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).105gitlab # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns106gitlab # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns107gitlab # [ 0.000029] arm-pv: using stolen time PV108gitlab # [ 0.000387] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)109gitlab # [ 0.000536] Console: colour dummy device 80x25110gitlab # [ 0.000543] printk: legacy console [tty0] enabled111gitlab # [ 0.000718] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)112gitlab # [ 0.000724] pid_max: default: 32768 minimum: 301113gitlab # [ 0.000813] LSM: initializing lsm=capability,landlock,yama,bpf,ima114gitlab # [ 0.000943] landlock: Up and running.115gitlab # [ 0.000946] Yama: becoming mindful.116gitlab # [ 0.001358] LSM support for eBPF active117gitlab # [ 0.001556] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)118gitlab # [ 0.001657] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)119gitlab # [ 0.002762] cacheinfo: Unable to detect cache hierarchy for CPU 0120gitlab # [ 0.003479] rcu: Hierarchical SRCU implementation.121gitlab # [ 0.003482] rcu: Max phase no-delay instances is 1000.122gitlab # [ 0.003628] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level123gitlab # [ 0.004687] fsl-mc MSI: its@8080000 domain created124gitlab # [ 0.004781] EFI services will not be available.125gitlab # [ 0.004946] smp: Bringing up secondary CPUs ...126gitlab # [ 0.005576] Detected PIPT I-cache on CPU1127gitlab # [ 0.005675] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000128gitlab # [ 0.005795] GICv3: CPU1: using allocated LPI pending table @0x0000000100f50000129gitlab # [ 0.005918] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40]130gitlab # [ 0.007012] Detected PIPT I-cache on CPU2131gitlab # [ 0.007135] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000132gitlab # [ 0.007256] GICv3: CPU2: using allocated LPI pending table @0x0000000100f60000133gitlab # [ 0.007379] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40]134gitlab # [ 0.008414] Detected PIPT I-cache on CPU3135gitlab # [ 0.008528] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000136gitlab # [ 0.008649] GICv3: CPU3: using allocated LPI pending table @0x0000000100f70000137gitlab # [ 0.008773] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40]138gitlab # [ 0.009259] smp: Brought up 1 node, 4 CPUs139gitlab # [ 0.009285] SMP: Total of 4 processors activated.140gitlab # [ 0.009288] CPU: All CPU(s) started at EL1141gitlab # [ 0.009297] CPU features: detected: Branch Target Identification142gitlab # [ 0.009301] CPU features: detected: ARMv8.4 Translation Table Level143gitlab # [ 0.009303] CPU features: detected: Instruction cache invalidation not required for I/D coherence144gitlab # [ 0.009307] CPU features: detected: Data cache clean to the PoU not required for I/D coherence145gitlab # [ 0.009310] CPU features: detected: Common not Private translations146gitlab # [ 0.009312] CPU features: detected: CRC32 instructions147gitlab # [ 0.009315] CPU features: detected: Data cache clean to Point of Deep Persistence148gitlab # [ 0.009318] CPU features: detected: Data cache clean to Point of Persistence149gitlab # [ 0.009321] CPU features: detected: Data independent timing control (DIT)150gitlab # [ 0.009324] CPU features: detected: E0PD151gitlab # [ 0.009326] CPU features: detected: Enhanced Counter Virtualization152gitlab # [ 0.009328] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)153gitlab # [ 0.009331] CPU features: detected: Enhanced Virtualization Traps154gitlab # [ 0.009334] CPU features: detected: Fine Grained Traps155gitlab # [ 0.009337] CPU features: detected: Generic authentication (architected QARMA5 algorithm)156gitlab # [ 0.009340] CPU features: detected: RCpc load-acquire (LDAPR)157gitlab # [ 0.009343] CPU features: detected: LSE atomic instructions158gitlab # [ 0.009345] CPU features: detected: Privileged Access Never159gitlab # [ 0.009347] CPU features: detected: PMUv3160gitlab # [ 0.009350] CPU features: detected: RAS Extension Support161gitlab # [ 0.009352] CPU features: detected: RASv1p1 Extension Support162gitlab # [ 0.009354] CPU features: detected: Random Number Generator163gitlab # [ 0.009357] CPU features: detected: Speculation barrier (SB)164gitlab # [ 0.009359] CPU features: detected: Stage-2 Force Write-Back165gitlab # [ 0.009362] CPU features: detected: TLB range maintenance instructions166gitlab # [ 0.009366] CPU features: detected: Speculative Store Bypassing Safe (SSBS)167gitlab # [ 0.009493] alternatives: applying system-wide alternatives168gitlab # [ 0.012388] CPU features: detected: BBM Level 2 without TLB conflict abort169gitlab # [ 0.012557] Memory: 5963828K/6291456K available (24448K kernel code, 7090K rwdata, 26340K rodata, 4736K init, 1106K bss, 272908K reserved, 32768K cma-reserved)170gitlab # [ 0.013976] devtmpfs: initialized171gitlab # [ 0.017884] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)172gitlab # [ 0.017953] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).173gitlab # [ 0.018124] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL174gitlab # [ 0.018129] 0 pages in range for non-PLT usage175gitlab # [ 0.018130] 508288 pages in range for PLT usage176gitlab # [ 0.018220] pinctrl core: initialized pinctrl subsystem177gitlab # [ 0.019024] DMI not present or invalid.178gitlab # [ 0.022228] NET: Registered PF_NETLINK/PF_ROUTE protocol family179gitlab # [ 0.024967] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations180gitlab # [ 0.025247] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations181gitlab # [ 0.026975] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations182gitlab # [ 0.026998] audit: initializing netlink subsys (disabled)183gitlab # [ 0.027330] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1184gitlab # [ 0.027793] thermal_sys: Registered thermal governor 'fair_share'185gitlab # [ 0.027797] thermal_sys: Registered thermal governor 'bang_bang'186gitlab # [ 0.027801] thermal_sys: Registered thermal governor 'step_wise'187gitlab # [ 0.027804] thermal_sys: Registered thermal governor 'user_space'188gitlab # [ 0.027807] thermal_sys: Registered thermal governor 'power_allocator'189gitlab # [ 0.027893] cpuidle: using governor ladder190gitlab # [ 0.027916] cpuidle: using governor menu191gitlab # [ 0.028115] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.192gitlab # [ 0.028333] ASID allocator initialised with 65536 entries193gitlab # [ 0.029507] Serial: AMBA PL011 UART driver194gitlab # [ 0.034613] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1195gitlab # [ 0.034902] printk: console [ttyAMA0] enabled196gitlab # [ 0.046875] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages197gitlab # [ 0.046896] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page198gitlab # [ 0.046905] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages199gitlab # [ 0.046914] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page200gitlab # [ 0.046922] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages201gitlab # [ 0.046930] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page202gitlab # [ 0.046938] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages203gitlab # [ 0.046946] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page204gitlab # [ 0.058686] fbcon: Taking over console205gitlab # [ 0.058697] ACPI: Interpreter disabled.206gitlab # [ 0.059686] iommu: Default domain type: Translated207gitlab # [ 0.059691] iommu: DMA domain TLB invalidation policy: strict mode208gitlab # [ 0.068349] SCSI subsystem initialized209gitlab # [ 0.069444] usbcore: registered new interface driver usbfs210gitlab # [ 0.069529] usbcore: registered new interface driver hub211gitlab # [ 0.069622] usbcore: registered new device driver usb212gitlab # [ 0.070485] pps_core: LinuxPPS API ver. 1 registered213gitlab # [ 0.070496] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>214gitlab # [ 0.070547] PTP clock support registered215gitlab # [ 0.070714] EDAC MC: Ver: 3.0.0216gitlab # [ 0.071192] scmi_core: SCMI protocol bus registered217gitlab # [ 0.072025] FPGA manager framework218gitlab # [ 0.074072] vgaarb: loaded219gitlab # [ 0.075898] clocksource: Switched to clocksource arch_sys_counter220gitlab # [ 0.076352] VFS: Disk quotas dquot_6.6.0221gitlab # [ 0.076377] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)222gitlab # [ 0.077197] netfs: FS-Cache loaded223gitlab # [ 0.077332] pnp: PnP ACPI: disabled224gitlab # [ 0.086969] NET: Registered PF_INET protocol family225gitlab # [ 0.087936] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)226gitlab # [ 0.117701] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)227gitlab # [ 0.117752] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)228gitlab # [ 0.117796] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)229gitlab # [ 0.118067] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)230gitlab # [ 0.118617] TCP: Hash tables configured (established 65536 bind 65536)231gitlab # [ 0.118710] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)232gitlab # [ 0.118763] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)233gitlab # [ 0.118873] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)234gitlab # [ 0.119103] NET: Registered PF_UNIX/PF_LOCAL protocol family235gitlab # [ 0.119181] NET: Registered PF_XDP protocol family236gitlab # [ 0.119195] PCI: CLS 0 bytes, default 64237gitlab # [ 0.119516] Trying to unpack rootfs image as initramfs...238gitlab # [ 0.124482] kvm [1]: HYP mode not available239gitlab # [ 0.167793] Initialise system trusted keyrings240gitlab # [ 0.167985] workingset: timestamp_bits=42 max_order=21 bucket_order=0241gitlab # [ 0.170253] squashfs: version 4.0 (2009/01/31) Phillip Lougher242gitlab # [ 0.170459] 9p: Installing v9fs 9p2000 file system support243gitlab # [ 0.209072] Key type asymmetric registered244gitlab # [ 0.209084] Asymmetric key parser 'x509' registered245gitlab # [ 0.209296] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)246gitlab # [ 0.209608] io scheduler mq-deadline registered247gitlab # [ 0.209618] io scheduler kyber registered248gitlab # [ 0.219603] pl061_gpio 9030000.pl061: PL061 GPIO chip registered249gitlab # [ 0.224381] ledtrig-cpu: registered to indicate activity on CPUs250gitlab # [ 0.225618] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:251gitlab # [ 0.225675] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000252gitlab # [ 0.225724] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000253gitlab # [ 0.225743] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000254gitlab # [ 0.225822] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits255gitlab # [ 0.225873] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]256gitlab # [ 0.226230] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00257gitlab # [ 0.226249] pci_bus 0000:00: root bus resource [bus 00-ff]258gitlab # [ 0.226259] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]259gitlab # [ 0.226268] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]260gitlab # [ 0.226278] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]261gitlab # [ 0.226454] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint262gitlab # [ 0.228042] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint263gitlab # [ 0.228687] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]264gitlab # [ 0.228724] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]265gitlab # [ 0.228849] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]266gitlab # [ 0.228885] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]267gitlab # [ 0.230326] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint268gitlab # [ 0.230928] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]269gitlab # [ 0.230963] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]270gitlab # [ 0.231042] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]271gitlab # [ 0.232612] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint272gitlab # [ 0.233202] pci 0000:00:03.0: BAR 0 [io 0x0000-0x001f]273gitlab # [ 0.233237] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]274gitlab # [ 0.233315] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]275gitlab # [ 0.234852] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint276gitlab # [ 0.235456] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]277gitlab # [ 0.235491] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]278gitlab # [ 0.235573] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]279gitlab # [ 0.237122] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint280gitlab # [ 0.237705] pci 0000:00:05.0: BAR 0 [io 0x0000-0x007f]281gitlab # [ 0.237741] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]282gitlab # [ 0.237823] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]283gitlab # [ 0.239351] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint284gitlab # [ 0.239968] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]285gitlab # [ 0.240003] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]286gitlab # [ 0.240081] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]287gitlab # [ 0.241633] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint288gitlab # [ 0.242306] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]289gitlab # [ 0.242342] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]290gitlab # [ 0.242422] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]291gitlab # [ 0.242459] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]292gitlab # [ 0.244116] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint293gitlab # [ 0.244784] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]294gitlab # [ 0.244874] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]295gitlab # [ 0.246439] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint296gitlab # [ 0.247136] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]297gitlab # [ 0.247215] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]298gitlab # [ 0.248562] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint299gitlab # [ 0.249207] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]300gitlab # [ 0.250039] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint301gitlab # [ 0.250756] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]302gitlab # [ 0.250791] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]303gitlab # [ 0.250871] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]304gitlab # [ 0.252427] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint305gitlab # [ 0.253071] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]306gitlab # [ 0.253108] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]307gitlab # [ 0.253199] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]308gitlab # [ 0.255041] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned309gitlab # [ 0.255059] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned310gitlab # [ 0.255071] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned311gitlab # [ 0.255246] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned312gitlab # [ 0.255386] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned313gitlab # [ 0.255534] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned314gitlab # [ 0.255676] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned315gitlab # [ 0.255824] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned316gitlab # [ 0.256003] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned317gitlab # [ 0.256134] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned318gitlab # [ 0.256286] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned319gitlab # [ 0.256422] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned320gitlab # [ 0.256591] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned321gitlab # [ 0.256722] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned322gitlab # [ 0.256783] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned323gitlab # [ 0.256837] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned324gitlab # [ 0.256905] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned325gitlab # [ 0.256958] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned326gitlab # [ 0.257011] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned327gitlab # [ 0.257079] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned328gitlab # [ 0.257144] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned329gitlab # [ 0.257199] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned330gitlab # [ 0.257254] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned331gitlab # [ 0.257326] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned332gitlab # [ 0.257383] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned333gitlab # [ 0.257437] pci 0000:00:05.0: BAR 0 [io 0x1000-0x107f]: assigned334gitlab # [ 0.257489] pci 0000:00:06.0: BAR 0 [io 0x1080-0x10ff]: assigned335gitlab # [ 0.257554] pci 0000:00:0b.0: BAR 0 [io 0x1100-0x113f]: assigned336gitlab # [ 0.257606] pci 0000:00:01.0: BAR 0 [io 0x1140-0x115f]: assigned337gitlab # [ 0.257670] pci 0000:00:02.0: BAR 0 [io 0x1160-0x117f]: assigned338gitlab # [ 0.257724] pci 0000:00:03.0: BAR 0 [io 0x1180-0x119f]: assigned339gitlab # [ 0.257789] pci 0000:00:04.0: BAR 0 [io 0x11a0-0x11bf]: assigned340gitlab # [ 0.257842] pci 0000:00:07.0: BAR 0 [io 0x11c0-0x11df]: assigned341gitlab # [ 0.257898] pci 0000:00:0c.0: BAR 0 [io 0x11e0-0x11ff]: assigned342gitlab # [ 0.257962] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]343gitlab # [ 0.257978] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]344gitlab # [ 0.257987] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]345gitlab # [ 0.261903] pci 0000:00:0a.0: enabling device (0000 -> 0002)346gitlab # [ 0.295556] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)347gitlab # [ 0.300401] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)348gitlab # [ 0.305467] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)349gitlab # [ 0.311475] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)350gitlab # [ 0.316104] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)351gitlab # [ 0.321400] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)352gitlab # [ 0.326544] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)353gitlab # [ 0.331566] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)354gitlab # [ 0.337620] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)355gitlab # [ 0.341895] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)356gitlab # [ 0.347672] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)357gitlab # [ 0.361120] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled358gitlab # [ 0.364884] msm_serial: driver initialized359gitlab # [ 0.365226] SuperH (H)SCI(F) driver initialized360gitlab # [ 0.365335] STM32 USART driver initialized361gitlab # [ 0.399861] loop: module loaded362gitlab # [ 0.400225] virtio_blk virtio4: 4/0/0 default/read/poll queues363gitlab # [ 0.403397] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)364gitlab # [ 0.406545] virtio_blk virtio5: 4/0/0 default/read/poll queues365gitlab # [ 0.409899] virtio_blk virtio5: [vdb] 12145304 512-byte logical blocks (6.22 GB/5.79 GiB)366gitlab # [ 0.413285] megasas: 07.734.00.00-rc1367gitlab # [ 0.414457] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]368gitlab # [ 0.417543] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000369gitlab # [ 0.417567] Intel/Sharp Extended Query Table at 0x0031370gitlab # [ 0.420199] Using buffer write method371gitlab # [ 0.420240] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]372gitlab # [ 0.423297] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000373gitlab # [ 0.423391] Intel/Sharp Extended Query Table at 0x0031374gitlab # [ 0.427331] Using buffer write method375gitlab # [ 0.427356] Concatenating MTD devices:376gitlab # [ 0.427360] (0): "0.flash"377gitlab # [ 0.427364] (1): "0.flash"378gitlab # [ 0.427367] into device "0.flash"379gitlab # [ 0.550898] Freeing initrd memory: 27184K380gitlab # [ 0.569571] tun: Universal TUN/TAP device driver, 1.6381gitlab # [ 0.578112] thunder_xcv, ver 1.0382gitlab # [ 0.578208] thunder_bgx, ver 1.0383gitlab # [ 0.578287] nicpf, ver 1.0384gitlab # [ 0.579968] e1000: Intel(R) PRO/1000 Network Driver385gitlab # [ 0.579994] e1000: Copyright (c) 1999-2006 Intel Corporation.386gitlab # [ 0.580102] e1000e: Intel(R) PRO/1000 Network Driver387gitlab # [ 0.580116] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.388gitlab # [ 0.580185] igb: Intel(R) Gigabit Ethernet Network Driver389gitlab # [ 0.580193] igb: Copyright (c) 2007-2014 Intel Corporation.390gitlab # [ 0.580254] igbvf: Intel(R) Gigabit Virtual Function Network Driver391gitlab # [ 0.580264] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.392gitlab # [ 0.580646] sky2: driver version 1.30393gitlab # [ 0.585367] usbcore: registered new interface driver usb-storage394gitlab # [ 0.585483] ehci-pci 0000:00:0a.0: EHCI Host Controller395gitlab # [ 0.585526] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1396gitlab # [ 0.585708] usbcore: registered new interface driver usbserial_generic397gitlab # [ 0.585775] usbserial: USB Serial support registered for generic398gitlab # [ 0.586110] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000399gitlab # [ 0.587473] hv_vmbus: registering driver hyperv_keyboard400gitlab # [ 0.590049] rtc-pl031 9010000.pl031: registered as rtc0401gitlab # [ 0.590102] rtc-pl031 9010000.pl031: setting system clock to 2026-08-13T15:54:08 UTC (1786636448)402gitlab # [ 0.590964] i2c_dev: i2c /dev entries driver403gitlab # [ 0.595997] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00404gitlab # [ 0.596581] hub 1-0:1.0: USB hub found405gitlab # [ 0.596620] hub 1-0:1.0: 6 ports detected406gitlab # [ 0.599239] sdhci: Secure Digital Host Controller Interface driver407gitlab # [ 0.599254] sdhci: Copyright(c) Pierre Ossman408gitlab # [ 0.600048] Synopsys Designware Multimedia Card Interface Driver409gitlab # [ 0.601099] sdhci-pltfm: SDHCI platform and OF driver helper410gitlab # [ 0.605651] hid: raw HID events driver (C) Jiri Kosina411gitlab # [ 0.606591] usbcore: registered new interface driver usbhid412gitlab # [ 0.606603] usbhid: USB HID core driver413gitlab # [ 0.624073] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available414gitlab # [ 0.628936] drop_monitor: Initializing network drop monitor service415gitlab # [ 0.629480] NET: Registered PF_INET6 protocol family416gitlab # [ 0.632415] Segment Routing with IPv6417gitlab # [ 0.632483] In-situ OAM (IOAM) with IPv6418gitlab # [ 0.632606] NET: Registered PF_PACKET protocol family419gitlab # [ 0.632956] 9pnet: Installing 9P2000 support420gitlab # [ 0.637133] Key type dns_resolver registered421gitlab # [ 0.657537] registered taskstats version 1422gitlab # [ 0.658034] Loading compiled-in X.509 certificates423gitlab # [ 0.684508] Demotion targets for Node 0: null424gitlab # [ 0.684818] Key type .fscrypt registered425gitlab # [ 0.684826] Key type fscrypt-provisioning registered426gitlab # [ 0.685011] ima: No TPM chip found, activating TPM-bypass!427gitlab # [ 0.685038] ima: Allocated hash algorithm: sha1428gitlab # [ 0.685070] ima: No architecture policies found429gitlab # [ 0.686338] input: gpio-keys as /devices/platform/gpio-keys/input/input0430gitlab # [ 0.718835] clk: Disabling unused clocks431gitlab # [ 0.718869] PM: genpd: Disabling unused power domains432gitlab # [ 0.725142] Freeing unused kernel memory: 4736K433gitlab # [ 0.725379] Run /init as init process434gitlab # [ 0.759346] systemd[1]: Successfully made /usr/ read-only.435gitlab # [ 0.843979] usb 1-1: new high-speed USB device number 2 using ehci-pci436gitlab # [ 1.002992] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1437gitlab # [ 1.088434] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0438gitlab # [ 1.094002] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)439gitlab # [ 1.094071] systemd[1]: Detected virtualization qemu.440gitlab # [ 1.094146] systemd[1]: Detected architecture arm64.441gitlab # [ 1.094161] systemd[1]: Running in initrd.442gitlab # [ 1.094988] systemd[1]: Initializing machine ID from random generator.443gitlab # [ 1.095365] systemd[1]: Hostname set to <gitlab>.444gitlab # [ 1.211988] usb 1-2: new high-speed USB device number 3 using ehci-pci445gitlab # [ 1.355786] systemd[1]: bpf-restrict-fs: LSM BPF program attached446gitlab # [ 1.370299] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2447gitlab # [ 1.370729] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0448gitlab # [ 1.451508] systemd[1]: Queued start job for default target Initrd Default Target.449gitlab # [ 1.481108] systemd[1]: Created slice Slice /system/modprobe.450gitlab # [ 1.481562] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.451gitlab # [ 1.481626] systemd[1]: Expecting device /dev/disk/by-label/nix-store...452gitlab # [ 1.481651] systemd[1]: Expecting device /dev/disk/by-label/nixos...453gitlab # [ 1.481697] systemd[1]: Reached target Path Units.454gitlab # [ 1.481729] systemd[1]: Reached target Slice Units.455gitlab # [ 1.481763] systemd[1]: Reached target Swaps.456gitlab # [ 1.481796] systemd[1]: Reached target Timer Units.457gitlab # [ 1.482104] systemd[1]: Listening on D-Bus System Message Bus Socket.458gitlab # [ 1.482465] systemd[1]: Listening on Journal Socket (/dev/log).459gitlab # [ 1.482741] systemd[1]: Listening on Journal Sockets.460gitlab # [ 1.483001] systemd[1]: Listening on udev Control Socket.461gitlab # [ 1.483192] systemd[1]: Listening on udev Kernel Socket.462gitlab # [ 1.483231] systemd[1]: Reached target Socket Units.463gitlab # [ 1.486180] systemd[1]: Starting Create List of Static Device Nodes...464gitlab # [ 1.489087] systemd[1]: Starting Load Kernel Module 9pnet_virtio...465gitlab # [ 1.489217] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs466gitlab # [ 1.492138] systemd[1]: Mounting Kernel Configuration File System...467gitlab # [ 1.520137] systemd[1]: Starting Journal Service...468gitlab # [ 1.522780] systemd[1]: Starting Load Kernel Modules...469gitlab # [ 1.523001] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os470gitlab # [ 1.528628] systemd[1]: Starting Coldplug All udev Devices...471gitlab # [ 1.533458] systemd[1]: Finished Create List of Static Device Nodes.472gitlab # [ 1.536468] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.473gitlab # [ 1.537538] systemd[1]: Finished Load Kernel Module 9pnet_virtio.474gitlab # [ 1.538380] systemd[1]: Mounted Kernel Configuration File System.475gitlab # [ 1.544231] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...476gitlab # [ 1.559610] systemd-journald[95]: Collecting audit messages is disabled.477gitlab # [ 1.571842] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.478gitlab # [ 1.574188] systemd[1]: Starting Create Static Device Nodes in /dev...479gitlab # [ 1.591355] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.480gitlab # [ 1.591480] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0481gitlab # [ 1.591662] [drm] features: -virgl +edid -resource_blob -host_visible482gitlab # [ 1.591667] [drm] features: -context_init483gitlab # [ 1.594394] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev484gitlab # [ 1.594822] systemd[1]: Finished Create Static Device Nodes in /dev.485gitlab # [ 1.594988] systemd[1]: Reached target Preparation for Local File Systems.486gitlab # [ 1.595009] systemd[1]: Reached target Local File Systems.487gitlab # [ 1.599270] [drm] number of scanouts: 1488gitlab # [ 1.599285] [drm] number of cap sets: 0489gitlab # [ 1.600048] systemd[1]: Starting Rule-based Manager for Device Events and Files...490gitlab # [ 1.604358] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic491gitlab # [ 1.604366] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0492gitlab # [ 1.608110] Console: switching to colour frame buffer device 160x50493gitlab # [ 1.611757] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device494gitlab # [ 1.633476] systemd[1]: Finished Load Kernel Modules.495gitlab # [ 1.633890] systemd-modules-load[96]: Using 4 probe threads496gitlab # [ 1.635004] systemd[1]: Starting Apply Kernel Variables...497gitlab # [ 1.637764] systemd[1]: Started Journal Service.498gitlab # [ 1.637215] systemd-modules-load[96]: Module 'virtio_balloon' is built in499gitlab # [ 1.638447] systemd-modules-load[96]: Module 'virtio_console' is built in500gitlab # [ 1.639700] systemd-modules-load[96]: Module 'virtio_rng' is built in501gitlab # [ 1.640941] systemd-modules-load[96]: Inserted module 'dm_mod'502gitlab # [ 1.642513] systemd-modules-load[96]: Inserted module 'virtio_gpu'503gitlab # [ 1.643644] systemd[1]: Starting Create System Files and Directories...504gitlab # [ 1.652401] systemd[1]: Finished Apply Kernel Variables.505gitlab # [ 1.660568] systemd[1]: Finished Create System Files and Directories.506gitlab # [ 1.662763] systemd-udevd[105]: Using default interface naming scheme 'v261'.507gitlab # [ 1.677392] systemd[1]: Started Rule-based Manager for Device Events and Files.508gitlab # [ 1.696182] systemd[1]: Starting Virtual Console Setup...509gitlab # [ 1.755171] systemd-vconsole-setup[130]: Configuration of first virtual console was skipped, ignoring remaining ones.510gitlab # [ 1.760317] systemd[1]: Finished Virtual Console Setup.511gitlab # [ 2.171433] systemd[1]: Finished Coldplug All udev Devices.512gitlab # [ 2.174196] systemd[1]: Reached target System Initialization.513gitlab # [ 2.176869] systemd[1]: Reached target Basic System.514gitlab # [ 2.363551] (udev-worker)[138]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.515gitlab # [ 2.371201] (udev-worker)[138]: Network interface NamePolicy= disabled on kernel command line.516gitlab # [ 2.373580] (udev-worker)[122]: Network interface NamePolicy= disabled on kernel command line.517gitlab # [ 2.386444] systemd[1]: Found device /dev/disk/by-label/nixos.518gitlab # [ 2.388718] systemd[1]: Reached target Initrd Root Device.519gitlab # [ 2.390245] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...520gitlab # [ 2.418909] systemd[1]: Found device /dev/disk/by-label/nix-store.521gitlab # [ 2.432928] systemd-fsck[152]: nixos: clean, 12/65536 files, 13019/262144 blocks522gitlab # [ 2.436387] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.523gitlab # [ 2.528047] systemd[1]: Mounting /sysroot...524gitlab # [ 2.575832] EXT4-fs (vda): mounted filesystem 5f0618aa-dd81-437c-b88d-2dd447fb5c11 r/w with ordered data mode. Quota mode: none.525gitlab # [ 2.580851] systemd[1]: Mounted /sysroot.526gitlab # [ 2.582686] systemd[1]: Reached target Initrd Root File System.527gitlab # [ 2.583556] systemd[1]: Mounting /sysroot/nix/.ro-store...528gitlab # [ 2.589001] systemd[1]: Mounting /sysroot/nix/.rw-store...529gitlab # [ 2.604368] systemd[1]: Mounting /sysroot/run...530gitlab # [ 2.611129] systemd[1]: Mounting /sysroot/tmp/shared...531gitlab # [ 2.617143] systemd[1]: Mounting /sysroot/tmp/xchg...532gitlab # [ 2.634621] erofs (device vdb): mounted with root inode @ nid 128.533gitlab # [ 2.632345] systemd[1]: Starting Mountpoints Configured in the Real Root...534gitlab # [ 2.640806] systemd[1]: Mounted /sysroot/nix/.ro-store.535gitlab # [ 2.642035] systemd[1]: Mounted /sysroot/nix/.rw-store.536gitlab # [ 2.643481] systemd[1]: Mounted /sysroot/run.537gitlab # [ 2.644839] systemd[1]: Mounted /sysroot/tmp/shared.538gitlab # [ 2.646414] systemd[1]: Mounted /sysroot/tmp/xchg.539gitlab # [ 2.647858] systemd-sysroot-fstab-check[166]: /sysroot should be mounted in the initrd, will request daemon-reload.540gitlab # [ 2.650158] systemd[1]: Starting rw-sysroot-nix-store.service...541gitlab # [ 2.651375] systemd[1]: Reload requested from client PID 166 ('systemd-sysroot') (unit initrd-parse-etc.service)...542gitlab # [ 2.653552] systemd[1]: Reloading...543gitlab # [ 2.747393] systemd[1]: Reloading finished in 96 ms.544gitlab # [ 2.802183] systemd-sysroot-fstab-check[166]: Requesting initrd-fs.target/start/replace...545gitlab # [ 2.807254] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.546gitlab # [ 2.808527] systemd[1]: Finished rw-sysroot-nix-store.service.547gitlab # [ 2.809357] systemd-sysroot-fstab-check[166]: Requesting swap.target/start/replace...548gitlab # [ 2.810693] systemd[1]: Starting rw-sysroot-nix-store.service...549gitlab # [ 2.813556] systemd[1]: initrd-parse-etc.service: Deactivated successfully.550gitlab # [ 2.824539] systemd[1]: Finished Mountpoints Configured in the Real Root.551gitlab # [ 2.825715] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.552gitlab # [ 2.833329] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.553gitlab # [ 2.834923] systemd[1]: Finished rw-sysroot-nix-store.service.554gitlab # [ 2.836919] systemd[1]: Mounting /sysroot/nix/store...555gitlab # [ 2.861398] systemd[1]: Mounted /sysroot/nix/store.556gitlab # [ 2.862373] systemd[1]: Reached target Initrd File Systems.557gitlab # [ 2.863541] systemd[1]: Starting Find NixOS closure...558gitlab # [ 2.865280] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...559gitlab # [ 2.884617] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.560gitlab # [ 2.891415] systemd[1]: Finished Find NixOS closure.561gitlab # [ 2.892704] systemd[1]: Reached target Initrd Default Target.562gitlab # [ 2.894167] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...563gitlab # [ 2.908830] systemd[1]: Stopped target Initrd Default Target.564gitlab # [ 2.909787] systemd[1]: Stopped target Basic System.565gitlab # [ 2.910531] systemd[1]: Stopped target Initrd Root Device.566gitlab # [ 2.911341] systemd[1]: Stopped target Path Units.567gitlab # [ 2.912049] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.568gitlab # [ 2.913093] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.569gitlab # [ 2.914159] systemd[1]: Stopped target Slice Units.570gitlab # [ 2.914859] systemd[1]: Stopped target Socket Units.571gitlab # [ 2.915573] systemd[1]: Stopped target System Initialization.572gitlab # [ 2.916515] systemd[1]: Stopped target Swaps.573gitlab # [ 2.917166] systemd[1]: Stopped target Timer Units.574gitlab # [ 2.923402] systemd[1]: dbus.socket: Deactivated successfully.575gitlab # [ 2.924428] systemd[1]: Closed D-Bus System Message Bus Socket.576gitlab # [ 2.925395] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.577gitlab # [ 2.930929] systemd[1]: Stopped Find NixOS closure.578gitlab # [ 2.931791] systemd[1]: Starting Load Kernel Module 9pnet_virtio...579gitlab # [ 2.933027] systemd[1]: Starting rw-sysroot-nix-store.service...580gitlab # [ 2.934319] systemd[1]: systemd-sysctl.service: Deactivated successfully.581gitlab # [ 2.935357] systemd[1]: Stopped Apply Kernel Variables.582gitlab # [ 2.936442] systemd[1]: systemd-modules-load.service: Deactivated successfully.583gitlab # [ 2.937627] systemd[1]: Stopped Load Kernel Modules.584gitlab # [ 2.938359] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.585gitlab # [ 2.939459] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.586gitlab # [ 2.940644] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.587gitlab # [ 2.941642] systemd[1]: Stopped Create System Files and Directories.588gitlab # [ 2.942506] systemd[1]: Stopped target Local File Systems.589gitlab # [ 2.943284] systemd[1]: Stopped target Preparation for Local File Systems.590gitlab # [ 2.944264] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.591gitlab # [ 2.945269] systemd[1]: Stopped Coldplug All udev Devices.592gitlab # [ 2.946053] systemd[1]: Stopping Rule-based Manager for Device Events and Files...593gitlab # [ 2.947073] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.594gitlab # [ 2.948108] systemd[1]: Stopped Virtual Console Setup.595gitlab # [ 2.948838] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.596gitlab # [ 2.949827] systemd[1]: Finished Load Kernel Module 9pnet_virtio.597gitlab # [ 2.950662] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.598gitlab # [ 2.951654] systemd[1]: Finished rw-sysroot-nix-store.service.599gitlab # [ 2.952573] systemd[1]: initrd-cleanup.service: Deactivated successfully.600gitlab # [ 2.953489] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.601gitlab # [ 2.962431] systemd[1]: systemd-udevd.service: Deactivated successfully.602gitlab # [ 2.963563] systemd[1]: Stopped Rule-based Manager for Device Events and Files.603gitlab # [ 2.965024] systemd[1]: systemd-udevd.service: Consumed 1.958s CPU time over 1.366s wall clock time, 27M memory peak.604gitlab # [ 2.966611] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.605gitlab # [ 2.967738] systemd[1]: Closed udev Control Socket.606gitlab # [ 2.968660] systemd[1]: Starting Cleanup udev Database...607gitlab # [ 2.969519] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.608gitlab # [ 2.970699] systemd[1]: Stopped Create Static Device Nodes in /dev.609gitlab # [ 2.971689] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.610gitlab # [ 2.973034] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.611gitlab # [ 2.974154] systemd[1]: kmod-static-nodes.service: Deactivated successfully.612gitlab # [ 2.975237] systemd[1]: Stopped Create List of Static Device Nodes.613gitlab # [ 3.010576] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.614gitlab # [ 3.012604] systemd[1]: Finished Cleanup udev Database.615gitlab # [ 3.013943] systemd[1]: Reached target Switch Root.616gitlab # [ 3.015218] systemd[1]: Starting NixOS Activation...617gitlab # [ 3.190009] initrd-nixos-activation-start[214]: booting system configuration /nix/store/v80z2zwr7jql61jinm2n0mzb8j0aw04f-nixos-system-gitlab-test618gitlab # [ 3.253276] initrd-nixos-activation-start[214]: running activation script...619gitlab # [ 3.590557] initrd-nixos-activation-start[238]: setting up /etc...620gitlab # [ 3.766670] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.621gitlab # [ 3.770192] systemd[1]: Finished NixOS Activation.622gitlab # [ 3.772540] systemd[1]: Starting Switch Root...623gitlab # [ 3.830774] systemd[1]: Switching root.624gitlab # [ 3.984886] systemd-journald[95]: Received SIGTERM from PID 1 (systemd).625gitlab # [ 4.635018] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)626gitlab # [ 4.635830] systemd[1]: Detected virtualization qemu.627gitlab # [ 4.636827] systemd[1]: Detected architecture arm64.628gitlab # [ 4.637893] systemd[1]: Detected first boot.629gitlab # [ 4.640192] systemd[1]: Initializing machine ID from random generator.630gitlab # [ 4.891748] systemd[1]: bpf-restrict-fs: LSM BPF program attached631gitlab # [ 5.012461] systemd[1]: Applying preset policy.632gitlab # [ 5.193685] systemd[1]: Populated /etc with preset unit settings.633gitlab # [ 5.343340] systemd[1]: initrd-switch-root.service: Deactivated successfully.634gitlab # [ 5.343761] systemd[1]: Stopped initrd-switch-root.service.635gitlab # [ 5.346360] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.636gitlab # [ 5.351527] systemd[1]: Created slice Slice /system/getty.637gitlab # [ 5.358920] systemd[1]: Created slice GitLab DevOps Platform Slice.638gitlab # [ 5.363287] systemd[1]: Created slice User and Session Slice.639gitlab # [ 5.363980] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.640gitlab # [ 5.364887] systemd[1]: Started Forward Password Requests to Wall Directory Watch.641gitlab # [ 5.365900] systemd[1]: Expecting device /dev/hvc0...642gitlab # [ 5.366624] systemd[1]: Expecting device /dev/ttyAMA0...643gitlab # [ 5.367364] systemd[1]: Reached target Local Encrypted Volumes.644gitlab # [ 5.368330] systemd[1]: Stopped target initrd-fs.target.645gitlab # [ 5.369401] systemd[1]: Stopped target initrd-root-fs.target.646gitlab # [ 5.370464] systemd[1]: Stopped target initrd-switch-root.target.647gitlab # [ 5.371558] systemd[1]: Reached target Virtual Machines and Containers.648gitlab # [ 5.372675] systemd[1]: Reached target Path Units.649gitlab # [ 5.373731] systemd[1]: Reached target Remote File Systems.650gitlab # [ 5.374804] systemd[1]: Reached target Slice Units.651gitlab # [ 5.375888] systemd[1]: Reached target Swaps.652gitlab # [ 5.379661] systemd[1]: Listening on Query the User Interactively for a Password.653gitlab # [ 5.384039] systemd[1]: Listening on Process Core Dump Socket.654gitlab # [ 5.387224] systemd[1]: Listening on Credential Encryption/Decryption.655gitlab # [ 5.390804] systemd[1]: Listening on Factory Reset Management.656gitlab # [ 5.392264] systemd[1]: Listening on Hostname Service Socket.657gitlab # [ 5.402953] systemd[1]: Starting Journal Log Access Socket...658gitlab # [ 5.405385] systemd[1]: Listening on Journal Audit Socket.659gitlab # [ 5.409695] systemd[1]: Listening on Console Output Muting Service Socket.660gitlab # [ 5.411430] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.661gitlab # [ 5.412701] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os662gitlab # [ 5.413762] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki663gitlab # [ 5.420199] systemd[1]: Listening on Disk Repartitioning Service Socket.664gitlab # [ 5.421608] systemd[1]: Listening on udev Control Socket.665gitlab # [ 5.423003] systemd[1]: Listening on udev Varlink Socket.666gitlab # [ 5.431317] systemd[1]: Mounting Huge Pages File System...667gitlab # [ 5.439723] systemd[1]: Mounting POSIX Message Queue File System...668gitlab # [ 5.457475] systemd[1]: Mounting Kernel Debug File System...669gitlab # [ 5.464789] systemd[1]: Mounting Kernel Trace File System...670gitlab # [ 5.470484] systemd[1]: Starting Create List of Static Device Nodes...671gitlab # [ 5.490426] systemd[1]: Starting Load Kernel Module 9pnet_virtio...672gitlab # [ 5.491703] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs673gitlab # [ 5.501166] systemd[1]: Mounting Kernel Configuration File System...674gitlab # [ 5.502135] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm675gitlab # [ 5.503018] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore676gitlab # [ 5.511346] systemd[1]: Starting Load Kernel Module fuse...677gitlab # [ 5.512319] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67678gitlab # [ 5.525636] systemd[1]: Starting Journal Service...679gitlab # [ 5.529962] systemd[1]: Starting Load Kernel Modules...680gitlab # [ 5.544091] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...681gitlab # [ 5.547313] fuse: init (API version 7.45)682gitlab # [ 5.552070] systemd[1]: Starting Remount Root and Kernel File Systems...683gitlab # [ 5.555292] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os684gitlab # [ 5.560592] systemd[1]: Starting Coldplug All udev Devices...685gitlab # [ 5.566360] systemd[1]: Listening on Journal Log Access Socket.686gitlab # [ 5.567720] systemd-journald[311]: Collecting audit messages is enabled.687gitlab # [ 5.570726] systemd[1]: Mounted Huge Pages File System.688gitlab # [ 5.573306] systemd[1]: Mounted POSIX Message Queue File System.689gitlab # [ 5.575711] systemd[1]: Mounted Kernel Debug File System.690gitlab # [ 5.578528] systemd[1]: Mounted Kernel Trace File System.691gitlab # [ 5.584627] systemd[1]: Finished Create List of Static Device Nodes.692gitlab # [ 5.586236] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.693gitlab # [ 5.588197] systemd[1]: Queued start job for default target Multi-User System.694gitlab # [ 5.592710] systemd[1]: Finished Load Kernel Module 9pnet_virtio.695gitlab # [ 5.593844] systemd[1]: Started Journal Service.696gitlab # [ 5.592374] systemd[1]: Unnecessary job was removed for /dev/vdb.697gitlab # [ 5.594617] systemd[1]: systemd-journald.service: Deactivated successfully.698gitlab # [ 5.596490] systemd-modules-load[312]: Using 3 probe threads699gitlab # [ 5.598163] systemd-modules-load[312]: Module 'atkbd' is built in700gitlab # [ 5.599428] systemd-modules-load[312]: Module 'loop' is built in701gitlab # [ 5.600720] systemd[1]: Mounted Kernel Configuration File System.702gitlab # [ 5.601910] systemd[1]: modprobe@fuse.service: Deactivated successfully.703gitlab # [ 5.603195] systemd[1]: Finished Load Kernel Module fuse.704gitlab # [ 5.604258] systemd-modules-load[312]: Inserted module 'tls'705gitlab # [ 5.605301] systemd[1]: Mounting FUSE Control File System...706gitlab # [ 5.606822] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...707gitlab # [ 5.612688] EXT4-fs (vda): re-mounted 5f0618aa-dd81-437c-b88d-2dd447fb5c11.708gitlab # [ 5.615828] systemd-oomd[314]: No swap; memory pressure usage will be degraded709gitlab # [ 5.628376] systemd[1]: Finished Load Kernel Modules.710gitlab # [ 5.630411] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.711gitlab # [ 5.633164] systemd[1]: Finished Remount Root and Kernel File Systems.712gitlab # [ 5.635181] systemd[1]: Mounted FUSE Control File System.713gitlab # [ 5.644715] systemd[1]: Listening on Disk Image Download Service Socket.714gitlab # [ 5.647454] systemd[1]: Starting Firewall...715gitlab # [ 5.651049] systemd[1]: Starting Flush Journal to Persistent Storage...716gitlab # [ 5.655055] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore717gitlab # [ 5.658176] systemd[1]: Starting Load/Save OS Random Seed...718gitlab # [ 5.671436] systemd-journald[311]: Received client request to flush runtime journal.719gitlab # [ 5.708413] systemd[1]: Starting Apply Kernel Variables...720gitlab # [ 5.709572] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os721gitlab # [ 5.710995] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.722gitlab # [ 5.716637] systemd[1]: Starting Create Static Device Nodes in /dev...723gitlab # [ 5.718217] systemd[1]: Finished Load/Save OS Random Seed.724gitlab # [ 5.719127] systemd[1]: Reached target First Boot Complete.725gitlab # [ 5.720071] systemd[1]: Finished Apply Kernel Variables.726gitlab # [ 5.720933] systemd[1]: Finished Create Static Device Nodes in /dev.727gitlab # [ 5.721980] systemd[1]: Reached target Preparation for Local File Systems.728gitlab # [ 5.723039] systemd[1]: Starting Rule-based Manager for Device Events and Files...729gitlab # [ 5.724687] systemd[1]: Finished Flush Journal to Persistent Storage.730gitlab # [ 5.790400] systemd-udevd[346]: Using default interface naming scheme 'v261'.731gitlab # [ 5.822976] systemd[1]: Started Rule-based Manager for Device Events and Files.732gitlab # [ 5.977981] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3733gitlab # [ 6.035821] systemd[1]: Starting Virtual Console Setup...734gitlab # [ 6.055523] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.735gitlab # [ 6.060419] systemd[1]: Stopped Virtual Console Setup.736gitlab # [ 6.063554] systemd[1]: Starting Virtual Console Setup...737gitlab # [ 6.064981] systemd[1]: Finished Firewall.738gitlab # [ 6.112794] systemd-vconsole-setup[474]: Configuration of first virtual console was skipped, ignoring remaining ones.739gitlab # [ 6.115018] systemd[1]: Finished Virtual Console Setup.740gitlab # [ 6.333666] systemd[1]: Finished Coldplug All udev Devices.741gitlab # [ 6.346133] systemd[1]: Mounting /run/wrappers...742gitlab # [ 6.386804] systemd[1]: Mounted /run/wrappers.743gitlab # [ 6.389027] systemd[1]: Reached target Local File Systems.744gitlab # [ 6.391556] systemd[1]: Listening on Boot Loader Control Service Socket.745gitlab # [ 6.394679] systemd[1]: Starting register-nix-paths.service...746gitlab # [ 6.397386] systemd[1]: Starting Create SUID/SGID Wrappers...747gitlab # [ 6.399944] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.748gitlab # [ 6.405115] systemd[1]: Starting Save Transient machine-id to Disk...749gitlab # [ 6.425058] systemd[1]: Starting Create System Files and Directories...750gitlab # [ 6.432403] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs751gitlab # [ 6.464199] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.752gitlab # [ 6.468441] systemd[1]: Finished Save Transient machine-id to Disk.753gitlab # [ 6.504420] systemd[1]: Finished Create System Files and Directories.754gitlab # [ 6.518913] systemd[1]: Starting Rebuild Journal Catalog...755gitlab # [ 6.520839] systemd[1]: Starting Record System Boot/Shutdown in UTMP...756gitlab # [ 6.523952] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.757gitlab # [ 6.535175] (udev-worker)[423]: Network interface NamePolicy= disabled on kernel command line.758gitlab # [ 6.547784] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped.759gitlab # [ 6.561590] (udev-worker)[400]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.760gitlab # [ 6.566589] (udev-worker)[400]: Network interface NamePolicy= disabled on kernel command line.761gitlab # [ 6.569004] systemd[1]: Finished Record System Boot/Shutdown in UTMP.762gitlab # [ 6.589874] systemd[1]: Finished Rebuild Journal Catalog.763gitlab # [ 6.596519] systemd[1]: Starting Update is Completed...764gitlab # [ 6.605863] systemd[1]: Condition check resulted in Virtio network device being skipped.765gitlab # [ 6.608757] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore766gitlab # [ 6.611337] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.767gitlab # [ 6.613264] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67768gitlab # [ 6.616324] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore769gitlab # [ 6.618652] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os770gitlab # [ 6.620711] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os771gitlab # [ 6.632507] systemd[1]: Finished Update is Completed.772gitlab # [ 6.645441] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.773gitlab # [ 6.646869] systemd[1]: Finished Create SUID/SGID Wrappers.774gitlab # [ 6.648198] systemd[1]: suid-sgid-wrappers.service: Consumed 160ms CPU time over 249ms wall clock time, 6.4M memory peak, 1.9M read from disk.775gitlab # [ 6.682987] mousedev: PS/2 mouse device common for all mice776gitlab # [ 6.905195] systemd[1]: Finished register-nix-paths.service.777gitlab # [ 6.908084] systemd[1]: Reached target System Initialization.778gitlab # [ 6.909046] systemd[1]: Started Discard unused filesystem blocks once a week.779gitlab # [ 6.912317] systemd[1]: Started logrotate.timer.780gitlab # [ 6.913143] systemd[1]: Started Daily Cleanup of Temporary Directories.781gitlab # [ 6.914601] systemd[1]: Reached target Timer Units.782gitlab # [ 6.915466] systemd[1]: Listening on D-Bus System Message Bus Socket.783gitlab # [ 6.916470] systemd[1]: Listening on Nix Daemon Socket.784gitlab # [ 6.921836] systemd[1]: Starting nixbot CI service socket...785gitlab # [ 6.924188] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.786gitlab # [ 6.925443] systemd[1]: Listening on nixbot CI service socket.787gitlab # [ 6.926303] systemd[1]: Reached target Socket Units.788gitlab # [ 6.929096] systemd[1]: Starting D-Bus System Message Bus...789gitlab # [ 6.965079] dbus-broker-launch[563]: Looking up NSS user entry for 'systemd-timesync'...790gitlab # [ 6.966271] dbus-broker-launch[563]: NSS returned no entry for 'systemd-timesync'791gitlab # [ 6.967562] dbus-broker-launch[563]: Invalid user-name in /nix/store/9zcyylhndlnizbwn48627991zr1jxg4p-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"792gitlab # [ 6.971696] systemd[1]: Started D-Bus System Message Bus.793gitlab # [ 6.983173] dbus-broker-launch[563]: Ready794gitlab # [ 6.984352] systemd[1]: Reached target Basic System.795gitlab # [ 6.987700] systemd[1]: Started backdoor.service.796gitlab # [ 6.989746] systemd[1]: Starting gitlab-config.service...797gitlab # [ 7.012275] systemd[1]: Starting Import lastlog data into lastlog2 database...798gitlab # [ 7.014560] systemd[1]: Starting Logrotate configuration check...799gitlab # [ 7.023959] systemd[1]: Starting Name Service Cache Daemon (nsncd)...800gitlab # [ 7.028974] systemd[1]: Starting Post-Boot Actions...801gitlab # [ 7.034029] logrotate[568]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.802gitlab # [ 7.040459] logrotate[568]: reading config file /nix/store/22afkmbkaxyx50bj9lbkkpmz7pd69hsf-logrotate.conf803gitlab # [ 7.041907] logrotate[568]: note: 'monthly' overrides previously specified 'weekly'804gitlab # [ 7.042944] logrotate[568]: Reading state from file: /var/lib/logrotate.status805gitlab # [ 7.043957] logrotate[568]: state file /var/lib/logrotate.status does not exist806gitlab # [ 7.045117] logrotate[568]: Allocating hash table for state file, size 64 entries807gitlab # [ 7.048253] logrotate[568]: Handling 4 logs808gitlab # [ 7.048899] logrotate[568]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed809gitlab # [ 7.051002] logrotate[568]: considering log /var/log/btmp810gitlab # [ 7.056164] logrotate[568]: Creating new state811gitlab # [ 7.057032] logrotate[568]: Now: 2026-08-13 15:54812gitlab # [ 7.057805] logrotate[568]: Last rotated at 2026-08-13 15:00813gitlab # [ 7.058602] logrotate[568]: log does not need rotating (log has already been rotated)814gitlab # [ 7.059708] logrotate[568]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed815gitlab # [ 7.062204] logrotate[568]: considering log /var/log/wtmp816gitlab # [ 7.063041] logrotate[568]: Creating new state817gitlab # [ 7.063689] logrotate[568]: Now: 2026-08-13 15:54818gitlab # [ 7.075341] logrotate[568]: Last rotated at 2026-08-13 15:00819gitlab # connecting to host...820gitlab # [ 7.085906] logrotate[568]: log does not need rotating (log has already been rotated)821gitlab # [ 7.087399] logrotate[568]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed822gitlab # [ 7.090207] logrotate[568]: switching euid from 0 to 165 and egid from 0 to 165 (pid 568)823gitlab # [ 7.091359] logrotate[568]: considering log /var/gitlab/state/log/*.log824gitlab # [ 7.092289] logrotate[568]: log /var/gitlab/state/log/*.log does not exist -- skipping825gitlab # [ 7.093447] logrotate[568]: Creating new state826gitlab # [ 7.094133] logrotate[568]: switching euid from 165 to 0 and egid from 165 to 0 (pid 568)827gitlab # [ 7.095642] logrotate[568]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed828gitlab # [ 7.099567] logrotate[568]: switching euid from 0 to 60 and egid from 0 to 60 (pid 568)829gitlab # [ 7.100917] logrotate[568]: considering log /var/log/nginx/*.log830gitlab # [ 7.101783] logrotate[568]: log /var/log/nginx/*.log does not exist -- skipping831gitlab # [ 7.102798] logrotate[568]: Creating new state832gitlab: Guest shell says: b'Spawning backdoor root shell...\n'833gitlab # [ 7.103408] logrotate[568]: not running postrotate script, since no logs were rotated834gitlab: connected to guest root shell835gitlab # [ 7.108441] logrotate[568]: switching euid from 60 to 0 and egid from 60 to 0 (pid 568)836gitlab: (connecting took 7.56 seconds)837gitlab # [ 7.109639] systemd[1]: Started Reset console on configuration changes.838gitlab: (finished: waiting for the VM to finish booting, in 7.56 seconds)839gitlab # [ 7.110772] nsncd[569]: Aug 13 15:54:14.981 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"840gitlab # [ 7.112819] systemd[1]: Starting resolvconf update...841gitlab # [ 7.113630] systemd[1]: Finished Logrotate configuration check.842gitlab # [ 7.114549] systemd[1]: Finished Post-Boot Actions.843gitlab # [ 7.115304] systemd[1]: Started Name Service Cache Daemon (nsncd).844gitlab # [ 7.116979] systemd[1]: Reached target Host and Network Name Lookups.845gitlab # [ 7.117908] systemd[1]: Reached target User and Group Name Lookups.846gitlab # [ 7.118698] systemd[1]: Starting User Login Management...847gitlab # [ 7.119472] systemd[1]: Finished Import lastlog data into lastlog2 database.848gitlab # [ 7.203110] systemd[1]: Stopped target Host and Network Name Lookups.849gitlab # [ 7.204191] systemd[1]: Stopping Host and Network Name Lookups...850gitlab # [ 7.205112] systemd[1]: Stopped target User and Group Name Lookups.851gitlab # [ 7.205972] systemd[1]: Stopping User and Group Name Lookups...852gitlab # [ 7.206917] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...853gitlab # [ 7.208168] systemd-logind[598]: New seat seat0.854gitlab # [ 7.210413] systemd[1]: nscd.service: Deactivated successfully.855gitlab # [ 7.235722] systemd[1]: Stopped Name Service Cache Daemon (nsncd).856gitlab # [ 7.236718] systemd[1]: nscd.service: Consumed 21ms CPU time over 184ms wall clock time, 7.4M memory peak, 5.8M read from disk.857gitlab # [ 7.238324] systemd[1]: Starting Name Service Cache Daemon (nsncd)...858gitlab # [ 7.240197] systemd-logind[598]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)859gitlab # [ 7.241491] systemd-logind[598]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)860gitlab # [ 7.242717] systemd-logind[598]: Watching system buttons on /dev/input/event0 (gpio-keys)861gitlab # [ 7.244785] systemd[1]: Started User Login Management.862gitlab # [ 7.245549] systemd[1]: Finished resolvconf update.863gitlab # [ 7.247646] systemd[1]: Reached target Preparation for Network.864gitlab # [ 7.252517] systemd[1]: Starting DHCP Client...865gitlab # [ 7.264227] systemd[1]: Starting linger-users.service...866gitlab # [ 7.272130] systemd[1]: Starting Address configuration of eth1...867gitlab # [ 7.274292] systemd[1]: Starting Extra networking commands....868gitlab # [ 7.290260] nsncd[671]: Aug 13 15:54:15.202 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"869gitlab # [ 7.294119] systemd[1]: Started Name Service Cache Daemon (nsncd).870gitlab # [ 7.298395] systemd[1]: Reached target Host and Network Name Lookups.871gitlab # [ 7.299344] systemd[1]: Reached target User and Group Name Lookups.872gitlab # [ 7.300925] systemd[1]: linger-users.service: Deactivated successfully.873gitlab # [ 7.302503] systemd[1]: Finished linger-users.service.874gitlab # [ 7.319372] network-addresses-eth1-start[678]: adding address 192.168.1.1/24... done875gitlab # [ 7.322955] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.876gitlab # [ 7.324189] systemd[1]: Stopped Virtual Console Setup.877gitlab # [ 7.324917] systemd[1]: systemd-vconsole-setup.service: Consumed 33ms CPU time over 1.258s wall clock time, 3.2M memory peak, 1.1M read from disk.878gitlab # [ 7.326670] network-addresses-eth1-start[678]: adding address 2001:db8:1::1/64... done879gitlab # [ 7.327722] systemd[1]: Stopping Virtual Console Setup...880gitlab # [ 7.330487] systemd[1]: Starting Virtual Console Setup...881gitlab # [ 7.334680] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.882gitlab # [ 7.336928] systemd[1]: Stopped Virtual Console Setup.883gitlab # [ 7.356340] systemd[1]: Finished Address configuration of eth1.884gitlab # [ 7.368562] systemd[1]: Starting Virtual Console Setup...885gitlab # [ 7.396704] dhcpcd[693]: dhcpcd-10.3.2 starting886gitlab # [ 7.398751] systemd-vconsole-setup[738]: Configuration of first virtual console was skipped, ignoring remaining ones.887gitlab # [ 7.401170] dhcpcd[757]: dev: loaded udev888gitlab # [ 7.401835] systemd[1]: Finished Extra networking commands..889gitlab # [ 7.402702] systemd[1]: Finished Virtual Console Setup.890gitlab # [ 7.406950] systemd[1]: Reached target Network.891gitlab # [ 7.409682] systemd[1]: Starting gitlab-workhorse.service...892gitlab # [ 7.414115] systemd[1]: Starting Nginx Web Server...893gitlab # [ 7.417082] 8021q: 802.1Q VLAN Support v1.8894gitlab # [ 7.417492] 8021q: adding VLAN 0 to HW filter on device eth1895gitlab # [ 7.420900] systemd[1]: Starting PostgreSQL Server...896gitlab # [ 7.425856] systemd[1]: Starting Redis Server - redis-gitlab...897gitlab # [ 7.431907] systemd[1]: Starting Permit User Sessions...898gitlab # [ 7.437261] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.899gitlab # [ 7.458088] cfg80211: Loading compiled-in X.509 certificates for regulatory database900gitlab # [ 7.463000] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'901gitlab # [ 7.463670] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'902gitlab # [ 7.468668] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2903gitlab # [ 7.469021] cfg80211: failed to load regulatory.db904gitlab # [ 7.476180] systemd[1]: Finished Permit User Sessions.905gitlab # [ 7.478677] systemd[1]: Started Getty on tty1.906gitlab # [ 7.483684] systemd[1]: Reached target Login Prompts.907gitlab # [ 7.510448] 8021q: adding VLAN 0 to HW filter on device eth0908gitlab # [ 7.507312] dhcpcd[757]: eth0: waiting for carrier909gitlab # [ 7.512215] dhcpcd[757]: eth0: carrier acquired910gitlab # [ 7.513801] dhcpcd[757]: DUID 00:01:00:01:32:10:a5:27:52:54:00:12:34:56911gitlab # [ 7.515188] dhcpcd[757]: eth0: IAID 00:12:34:56912gitlab # [ 7.515935] dhcpcd[757]: eth0: adding address fe80::5054:ff:fe12:3456913gitlab # [ 7.582778] nginx-pre-start[796]: nginx: the configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf syntax is ok914gitlab # [ 7.585685] nginx-pre-start[796]: nginx: configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf test is successful915gitlab # [ 7.587701] systemd[1]: Started Nginx Web Server.916gitlab # [ 7.597014] redis-server[792]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.917gitlab # [ 7.599738] redis-server[792]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo918gitlab # [ 7.601088] redis-server[792]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=792, just started919gitlab # [ 7.602695] redis-server[792]: Configuration loaded920gitlab # [ 7.603554] systemd[1]: Started Redis Server - redis-gitlab.921gitlab # [ 7.604615] redis[792]: monotonic clock: ARM CNTVCT @ 1000 ticks/us922gitlab # [ 7.605766] redis[792]: Running mode=standalone, port=0.923gitlab # [ 7.606703] redis[792]: Server initialized924gitlab # [ 7.607805] redis[792]: Ready to accept connections unix925gitlab # [ 7.608814] redis[792]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.926gitlab # [ 7.625281] postgresql-pre-start[800]: The files belonging to this database system will be owned by user "postgres".927gitlab # [ 7.627481] postgresql-pre-start[800]: This user must also own the server process.928gitlab # [ 7.629234] postgresql-pre-start[800]: The database cluster will be initialized with locale "en_US.UTF-8".929gitlab # [ 7.630482] postgresql-pre-start[800]: The default database encoding has accordingly been set to "UTF8".930gitlab # [ 7.631750] postgresql-pre-start[800]: The default text search configuration will be set to "english".931gitlab # [ 7.633198] postgresql-pre-start[800]: Data page checksums are enabled.932gitlab # [ 7.634153] postgresql-pre-start[800]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok933gitlab # [ 7.635475] postgresql-pre-start[800]: creating subdirectories ... ok934gitlab # [ 7.637155] postgresql-pre-start[800]: selecting dynamic shared memory implementation ... posix935gitlab # [ 7.672767] postgresql-pre-start[800]: selecting default "max_connections" ... 100936gitlab # [ 7.719262] postgresql-pre-start[800]: selecting default "shared_buffers" ... 128MB937gitlab # [ 8.009679] systemd[1]: Started gitlab-workhorse.service.938gitlab # [ 8.063912] dhcpcd[757]: eth0: soliciting a DHCP lease939gitlab # [ 8.072663] dhcpcd[757]: eth0: offered 10.0.2.15 from 10.0.2.2940gitlab # [ 8.088227] dhcpcd[757]: eth0: probing address 10.0.2.15/24941gitlab # [ 8.183168] postgresql-pre-start[800]: selecting default time zone ... UTC942gitlab # [ 8.186616] postgresql-pre-start[800]: creating configuration files ... ok943gitlab # [ 8.296809] gitlab-workhorse[821]: time="2026-08-13T15:54:16Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4944gitlab # [ 8.299537] gitlab-workhorse[821]: time="2026-08-13T15:54:16Z" level=info msg="Using redis/go-redis"945gitlab # [ 8.301848] gitlab-workhorse[821]: time="2026-08-13T15:54:16Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix946gitlab # [ 8.444546] postgresql-pre-start[800]: running bootstrap script ... ok947gitlab # [ 9.202924] postgresql-pre-start[800]: performing post-bootstrap initialization ... ok948gitlab # [ 9.336318] dhcpcd[757]: eth0: soliciting an IPv6 router949gitlab # [ 9.339277] dhcpcd[757]: eth0: Router Advertisement from fe80::2950gitlab # [ 9.342461] dhcpcd[757]: eth0: adding address fec0::5054:ff:fe12:3456/64951gitlab # [ 9.345979] dhcpcd[757]: eth0: adding route to fec0::/64952gitlab # [ 9.349827] dhcpcd[757]: eth0: adding default route via fe80::2953gitlab # [ 9.447978] postgresql-pre-start[800]: syncing data to disk ... ok954gitlab # [ 9.450738] postgresql-pre-start[800]: initdb: warning: enabling "trust" authentication for local connections955gitlab # [ 9.454824] postgresql-pre-start[800]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.956gitlab # [ 9.461336] postgresql-pre-start[800]: Success. You can now start the database server using:957gitlab # [ 9.464862] postgresql-pre-start[800]: pg_ctl -D /var/lib/postgresql/18 -l logfile start958gitlab # [ 9.696644] postgres[856]: [856] LOG: starting PostgreSQL 18.4 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit959gitlab # [ 9.702148] postgres[856]: [856] LOG: listening on IPv6 address "::1", port 5432960gitlab # [ 9.705432] postgres[856]: [856] LOG: listening on IPv4 address "127.0.0.1", port 5432961gitlab # [ 9.710049] postgres[856]: [856] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"962gitlab # [ 9.714855] postgres[868]: [868] LOG: database system was shut down at 2026-08-13 15:54:17 GMT963gitlab # [ 9.729049] postgres[856]: [856] LOG: database system is ready to accept connections964gitlab # [ 9.734269] systemd[1]: Started PostgreSQL Server.965gitlab # [ 9.741482] systemd[1]: Starting PostgreSQL Setup Scripts...966gitlab # [ 9.974577] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[869]: mkdir -p /var/gitlab/state/home/.ssh: OK967gitlab # [ 9.978874] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[869]: chmod 700 /var/gitlab/state/home/.ssh: OK968gitlab # [ 10.054614] systemd[1]: Finished gitlab-config.service.969gitlab # [ 10.060205] systemd[1]: Started gitaly.service.970gitlab # [ 10.127543] postgresql-setup-start[881]: CREATE DATABASE971gitlab # [ 10.187206] postgresql-setup-start[900]: CREATE ROLE972gitlab # [ 10.215798] postgresql-setup-start[902]: ALTER DATABASE973gitlab # [ 10.268405] postgresql-setup-start[907]: CREATE ROLE974gitlab # [ 10.273372] systemd[1]: Finished PostgreSQL Setup Scripts.975gitlab # [ 10.275860] systemd[1]: Reached target PostgreSQL.976gitlab # [ 10.280451] systemd[1]: Starting gitlab-db-config.service...977gitlab # [ 10.286004] systemd[1]: Starting gitlab-postgresql.service...978gitlab # [ 10.489543] gitlab-postgresql-start[926]: CREATE DATABASE979gitlab # [ 10.570453] gitlab-postgresql-start[938]: CREATE EXTENSION980gitlab # [ 10.698953] gitlab-postgresql-start[940]: CREATE EXTENSION981gitlab # [ 10.708929] systemd[1]: Finished gitlab-postgresql.service.982gitlab # [ 10.803986] gitaly[895]: time="2026-08-13T15:54:18.716Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/0r0qd84zrxhqq373hk9spv8j9pg0qlnq-gitaly.toml' and fix the errors that are printed." pid=895983gitlab # [ 10.810770] gitaly[895]: time="2026-08-13T15:54:18.717Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=895984gitlab # [ 10.813739] gitaly[895]: time="2026-08-13T15:54:18.717Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=895985gitlab # [ 10.818845] gitaly[895]: time="2026-08-13T15:54:18.717Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=895986gitlab # [ 10.822151] gitaly[895]: time="2026-08-13T15:54:18.717Z" level=info msg="Starting Gitaly" pid=895 version=987gitlab # [ 11.010766] gitaly[895]: time="2026-08-13T15:54:18.924Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=206 pid=895988gitlab # [ 11.012567] gitaly[895]: time="2026-08-13T15:54:18.924Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=895989gitlab # [ 11.014029] gitaly[895]: time="2026-08-13T15:54:18.924Z" level=info msg="finished initializing command factory" duration_ms=0 pid=895990gitlab # [ 11.019787] gitaly[895]: time="2026-08-13T15:54:18.924Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-895/git-exec-2764060919.d/git pid=895991gitlab # [ 11.022061] gitaly[895]: time="2026-08-13T15:54:18.935Z" level=info msg="finished detecting git version" duration_ms=10 pid=895992gitlab # [ 11.023615] gitaly[895]: time="2026-08-13T15:54:18.937Z" level=info msg="using Git version" pid=895 version=2.53.g993gitlab # [ 11.025354] gitaly[895]: time="2026-08-13T15:54:18.939Z" level=info msg="clearing disk cache object folder" pid=895 storage=default994gitlab # [ 11.027195] gitaly[895]: time="2026-08-13T15:54:18.940Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1645587848 pid=895 storage=default995gitlab # [ 11.029748] gitaly[895]: time="2026-08-13T15:54:18.943Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1645587848 pid=895 storage=default996gitlab # [ 11.032351] gitaly[895]: time="2026-08-13T15:54:18.945Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=895997gitlab # [ 11.034672] gitaly[895]: time="2026-08-13T15:54:18.945Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=895998gitlab # [ 11.037142] gitaly[895]: time="2026-08-13T15:54:18.946Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1645587848 clear_duration_ms=0 pid=895 storage=default999gitlab # [ 11.046136] gitaly[895]: time="2026-08-13T15:54:18.959Z" level=info msg="counting repositories" pid=8951000gitlab # [ 11.047474] gitaly[895]: time="2026-08-13T15:54:18.959Z" level=info msg="starting to count repositories" pid=895 storage_path=/var/gitlab/state/repositories1001gitlab # [ 11.049830] gitaly[895]: time="2026-08-13T15:54:18.960Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=895 storage_path=/var/gitlab/state/repositories1002gitlab # [ 11.051839] gitaly[895]: time="2026-08-13T15:54:18.960Z" level=info msg="completed counting all repositories" counting_duration=0 pid=8951003gitlab # [ 11.053533] gitaly[895]: time="2026-08-13T15:54:18.960Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=8951004gitlab # [ 11.055545] gitaly[895]: time="2026-08-13T15:54:18.960Z" level=info msg="finished tempdir cleaner walk" pid=895 storage=default time_ms=01005gitlab # [ 11.057194] gitaly[895]: time="2026-08-13T15:54:18.960Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=895 schema=unix1006gitlab # [ 11.059019] gitaly[895]: time="2026-08-13T15:54:18.960Z" level=info msg="listening at address" address=/run/gitaly/gitaly-895/sock.d/intern pid=895 schema=unix1007gitlab # [ 11.060855] gitaly[895]: time="2026-08-13T15:54:18.963Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=8951008gitlab # [ 11.062316] gitaly[895]: time="2026-08-13T15:54:18.963Z" level=info msg="Started Gitaly" duration_ms=246 pid=8951009gitlab # [ 11.063555] gitaly[895]: time="2026-08-13T15:54:18.964Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=8951010gitlab # [ 11.065131] gitaly[895]: time="2026-08-13T15:54:18.964Z" level=info msg="maintenance: daily scheduled" pid=895 scheduled="2026-08-14 12:00:00 +0000 UTC"1011gitlab # [ 11.555845] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[917]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1012gitlab # [ 11.566093] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[917]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1013gitlab # [ 11.576074] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[917]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1014gitlab # [ 13.017329] dhcpcd[757]: eth0: leased 10.0.2.15 for 86400 seconds1015gitlab # [ 13.017625] dhcpcd[757]: eth0: adding route to 10.0.2.0/241016gitlab # [ 13.017899] dhcpcd[757]: eth0: adding default route via 10.0.2.21017gitlab # [ 13.209409] systemd[1]: Started DHCP Client.1018gitlab # [ 13.214195] systemd[1]: Reached target Network is Online.1019gitlab # [ 14.377024] gitaly[895]: time="2026-08-13T15:54:22.289Z" level=info msg="License database preloaded" duration_ms=3563 pid=8951020gitlab # [ 56.899399] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[917]: W, [2026-08-13T15:55:04.811578 #917] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1021gitlab # [ 58.372790] gitlab-workhorse[821]: time="2026-08-13T15:55:06Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1022gitlab # [ 60.785874] postgres[1448]: [1448] ERROR: relation "feature_gates" does not exist at character 5231023gitlab # [ 60.786371] postgres[1448]: [1448] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1024gitlab # [ 60.786497] postgres[1448]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1025gitlab # [ 60.786619] postgres[1448]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1026gitlab # [ 60.786782] postgres[1448]: attidentity AS identity,1027gitlab # [ 60.786911] postgres[1448]: attgenerated as attgenerated1028gitlab # [ 60.787030] postgres[1448]: FROM pg_attribute a1029gitlab # [ 60.787157] postgres[1448]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1030gitlab # [ 60.787328] postgres[1448]: LEFT JOIN pg_type t ON a.atttypid = t.oid1031gitlab # [ 60.787444] postgres[1448]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1032gitlab # [ 60.787542] postgres[1448]: WHERE a.attrelid = '"feature_gates"'::regclass1033gitlab # [ 60.787653] postgres[1448]: AND a.attnum > 0 AND NOT a.attisdropped1034gitlab # [ 60.787750] postgres[1448]: ORDER BY a.attnum1035gitlab # [ 60.787865] postgres[1448]:1036gitlab # [ 65.913779] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1499]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1037gitlab # [ 65.914198] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1499]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1038gitlab # [ 68.382951] gitlab-workhorse[821]: time="2026-08-13T15:55:16Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1039gitlab # [ 78.390818] gitlab-workhorse[821]: time="2026-08-13T15:55:26Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1040gitlab # [ 88.397682] gitlab-workhorse[821]: time="2026-08-13T15:55:36Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1041gitlab # [ 92.141582] postgres[1593]: [1593] ERROR: relation "table_without_models" does not exist1042gitlab # [ 92.141961] postgres[1593]: [1593] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1043gitlab # [ 98.406962] gitlab-workhorse[821]: time="2026-08-13T15:55:46Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1044gitlab # [ 108.417078] gitlab-workhorse[821]: time="2026-08-13T15:55:56Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1045gitlab # [ 118.427057] gitlab-workhorse[821]: time="2026-08-13T15:56:06Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1046gitlab # [ 122.693368] systemd[1]: Finished gitlab-db-config.service.1047gitlab # [ 122.699108] systemd[1]: Started gitlab-sidekiq.service.1048gitlab # [ 122.704606] systemd[1]: Starting gitlab.service...1049gitlab # [ 123.250032] bundle[1978]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1050gitlab # [ 123.256504] bundle[1978]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1051gitlab # [ 123.262274] bundle[1978]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1052gitlab # [ 127.926567] sidekiq-cluster[1977]: {"severity":"INFO","time":"2026-08-13T15:56:15.810Z","message":"Starting cluster with 1 processes"}1053gitlab # [ 127.970406] bundle[1978]: {"timestamp":"2026-08-13T15:56:15.853Z","pid":1978,"message":"* Enabling systemd notification integration"}1054gitlab # [ 127.975452] bundle[1978]: {"timestamp":"2026-08-13T15:56:15.883Z","pid":1978,"message":"Puma starting in cluster mode..."}1055gitlab # [ 127.980051] bundle[1978]: {"timestamp":"2026-08-13T15:56:15.883Z","pid":1978,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1056gitlab # [ 127.984747] bundle[1978]: {"timestamp":"2026-08-13T15:56:15.883Z","pid":1978,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1057gitlab # [ 127.990611] bundle[1978]: {"timestamp":"2026-08-13T15:56:15.883Z","pid":1978,"message":"* Min threads: 0"}1058gitlab # [ 127.994552] bundle[1978]: {"timestamp":"2026-08-13T15:56:15.883Z","pid":1978,"message":"* Max threads: 4"}1059gitlab # [ 127.998557] bundle[1978]: {"timestamp":"2026-08-13T15:56:15.883Z","pid":1978,"message":"* Environment: production"}1060gitlab # [ 128.002821] bundle[1978]: {"timestamp":"2026-08-13T15:56:15.883Z","pid":1978,"message":"* Master PID: 1978"}1061gitlab # [ 128.006920] bundle[1978]: {"timestamp":"2026-08-13T15:56:15.883Z","pid":1978,"message":"* Workers: 2"}1062gitlab # [ 128.010912] bundle[1978]: {"timestamp":"2026-08-13T15:56:15.883Z","pid":1978,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1063gitlab # [ 128.016004] bundle[1978]: {"timestamp":"2026-08-13T15:56:15.883Z","pid":1978,"message":"* Preloading application"}1064gitlab # [ 128.431092] gitlab-workhorse[821]: time="2026-08-13T15:56:16Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1065gitlab # [ 138.444257] gitlab-workhorse[821]: time="2026-08-13T15:56:26Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1066gitlab # [ 148.454230] gitlab-workhorse[821]: time="2026-08-13T15:56:36Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1067gitlab # [ 158.455235] gitlab-workhorse[821]: time="2026-08-13T15:56:46Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1068gitlab # [ 167.120124] bundle[1978]: W, [2026-08-13T15:56:55.032586 #1978] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1069gitlab # [ 168.462234] gitlab-workhorse[821]: time="2026-08-13T15:56:56Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1070gitlab # [ 171.653831] sidekiq-cluster[2027]: 2026-08-13T15:56:59.566Z pid=2027 tid=wn7 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2027, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>430583808}1071gitlab # [ 171.948186] sidekiq-cluster[2027]: W, [2026-08-13T15:56:59.858584 #2027] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1072gitlab # [ 172.015738] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:56:59.929Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1073gitlab # [ 175.855395] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.767Z","message":"GitLab reliable fetch activated!"}1074gitlab # [ 175.855779] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.768Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1075gitlab # [ 175.892415] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.805Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1076gitlab # [ 175.899407] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.809Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1077gitlab # [ 175.906604] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.812Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1078gitlab # [ 175.913348] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.815Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1079gitlab # [ 175.920802] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.818Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1080gitlab # [ 175.927338] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.821Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1081gitlab # [ 175.933364] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.824Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1082gitlab # [ 175.938483] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.826Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1083gitlab # [ 175.943285] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.828Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1084gitlab # [ 175.948002] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.831Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1085gitlab # [ 175.952526] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.833Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1086gitlab # [ 175.956571] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.836Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1087gitlab # [ 175.960049] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.838Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1088gitlab # [ 175.963585] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.840Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1089gitlab # [ 175.967142] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.843Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1090gitlab # [ 175.970543] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.845Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1091gitlab # [ 175.973595] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.849Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1092gitlab # [ 175.976405] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.853Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1093gitlab # [ 175.979397] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.857Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1094gitlab # [ 175.982279] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.860Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1095gitlab # [ 175.985259] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.863Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1096gitlab # [ 175.988229] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.866Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1097gitlab # [ 175.990799] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.869Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1098gitlab # [ 175.993481] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.872Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1099gitlab # [ 175.996071] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.874Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1100gitlab # [ 175.998453] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.877Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1101gitlab # [ 176.000767] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.881Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1102gitlab # [ 176.004655] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.889Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1103gitlab # [ 176.007602] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.895Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1104gitlab # [ 176.010787] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.902Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1105gitlab # [ 176.013671] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.908Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1106gitlab # [ 176.016812] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.914Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1107gitlab # [ 176.019530] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.919Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1108gitlab # [ 176.022639] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.924Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1109gitlab # [ 176.025588] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.928Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1110gitlab # [ 176.028484] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.931Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1111gitlab # [ 176.031380] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.935Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1112gitlab # [ 176.034354] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.938Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1113gitlab # [ 176.037223] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.941Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1114gitlab # [ 176.039958] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.944Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1115gitlab # [ 176.043086] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.947Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1116gitlab # [ 176.046100] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.949Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1117gitlab # [ 176.048940] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.953Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1118gitlab # [ 176.051510] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.956Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1119gitlab # [ 176.054358] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.959Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1120gitlab # [ 176.057141] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.961Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1121gitlab # [ 176.059608] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.964Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1122gitlab # [ 176.062201] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.966Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1123gitlab # [ 176.064543] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.969Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1124gitlab # [ 176.066850] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.971Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1125gitlab # [ 176.069163] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.974Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1126gitlab # [ 176.071281] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.976Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1127gitlab # [ 176.077805] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.991Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1128gitlab # [ 176.080545] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.994Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1129gitlab # [ 176.083414] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.996Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1130gitlab # [ 176.086187] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:03.998Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1131gitlab # [ 176.088831] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.000Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1132gitlab # [ 176.091558] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.003Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1133gitlab # [ 176.094380] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.005Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1134gitlab # [ 176.097124] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.007Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1135gitlab # [ 176.099536] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.009Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1136gitlab # [ 176.102099] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.011Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1137gitlab # [ 176.104586] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.013Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1138gitlab # [ 176.107864] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.021Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1139gitlab # [ 176.114480] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.028Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1140gitlab # [ 176.121283] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.034Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1141gitlab # [ 176.125671] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.039Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1142gitlab # [ 176.129980] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.043Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1143gitlab # [ 176.134081] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.047Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1144gitlab # [ 176.138202] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.051Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1145gitlab # [ 176.143246] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.056Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1146gitlab # [ 176.147273] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.060Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1147gitlab # [ 176.150995] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.064Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1148gitlab # [ 176.154706] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.068Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1149gitlab # [ 176.158515] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.072Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1150gitlab # [ 176.162533] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.076Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1151gitlab # [ 176.166541] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.080Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1152gitlab # [ 176.170391] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.084Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1153gitlab # [ 176.173803] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.087Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1154gitlab # [ 176.176862] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.090Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1155gitlab # [ 176.179949] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.093Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1156gitlab # [ 176.183240] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.096Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1157gitlab # [ 176.186811] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.100Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1158gitlab # [ 176.189767] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.103Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1159gitlab # [ 176.192703] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.106Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1160gitlab # [ 176.195396] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.109Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1161gitlab # [ 176.198706] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.112Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1162gitlab # [ 176.201554] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.115Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1163gitlab # [ 176.204273] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.117Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1164gitlab # [ 176.206882] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.120Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1165gitlab # [ 176.210620] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.123Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1166gitlab # [ 176.214586] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.128Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1167gitlab # [ 176.219528] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.133Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1168gitlab # [ 176.224023] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.137Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1169gitlab # [ 176.230633] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.144Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1170gitlab # [ 176.239872] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.150Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1171gitlab # [ 176.242763] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.155Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1172gitlab # [ 176.245704] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.159Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1173gitlab # [ 176.266619] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.178Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1174gitlab # [ 176.273395] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.187Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1175gitlab # [ 176.276158] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.189Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1176gitlab # [ 176.284107] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.197Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1177gitlab # [ 176.295370] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.208Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1178gitlab # [ 176.354431] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.266Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1179gitlab # [ 176.365267] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.278Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1180gitlab # [ 176.372973] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.286Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1181gitlab # [ 176.378487] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.292Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1182gitlab # [ 176.389812] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.303Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1183gitlab # [ 176.401203] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:04.314Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1184gitlab # [ 178.470253] gitlab-workhorse[821]: time="2026-08-13T15:57:06Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1185gitlab # [ 188.478323] gitlab-workhorse[821]: time="2026-08-13T15:57:16Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1186gitlab # [ 198.480219] gitlab-workhorse[821]: time="2026-08-13T15:57:26Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1187gitlab # [ 208.492322] gitlab-workhorse[821]: time="2026-08-13T15:57:36Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1188gitlab # [ 217.164874] postgres[2775]: [2775] ERROR: relation "table_without_models" does not exist1189gitlab # [ 217.168468] postgres[2775]: [2775] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1190gitlab # [ 217.859914] postgres[2785]: [2785] ERROR: relation "table_without_models" does not exist1191gitlab # [ 217.860320] postgres[2785]: [2785] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1192gitlab # [ 218.502205] gitlab-workhorse[821]: time="2026-08-13T15:57:46Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1193gitlab # [ 222.138725] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:50.051Z","message":"Booted Rails 7.2.3.1 application in production environment"}1194gitlab # [ 222.141678] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:50.054Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1195gitlab # [ 222.143716] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:50.054Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1196gitlab # [ 222.145671] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:50.054Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1197gitlab # [ 222.150495] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:50.064Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1198gitlab # [ 224.832923] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:52.744Z","message":"Cleaning working queues"}1199gitlab # [ 224.841266] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:52.754Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"d526051cadb808ad1460402e","created_at":"2026-08-13T15:56:10.091Z","trace_propagation_headers":{"sentry-trace":"dff3e25dbbb648f493a27bb3c21e408c-ce2327ff89e54403","baggage":"sentry-trace_id=dff3e25dbbb648f493a27bb3c21e408c,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"48c0f0f8558118002204949bac84e566","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-13T15:56:10.103Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-d526051cadb808ad1460402e: start","job_status":"start","queue_duration_s":102.650858,"scheduling_latency_s":102.650958}1200gitlab # [ 224.874851] bundle[1978]: {"timestamp":"2026-08-13T15:57:52.787Z","pid":1978,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1201gitlab # [ 224.880333] bundle[1978]: {"timestamp":"2026-08-13T15:57:52.787Z","pid":1978,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1202gitlab # [ 224.885019] bundle[1978]: {"timestamp":"2026-08-13T15:57:52.787Z","pid":1978,"message":"! #\u003cThread:0x0000eb7df47efbb8 /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1203gitlab # [ 224.900231] bundle[1978]: {"timestamp":"2026-08-13T15:57:52.787Z","pid":1978,"message":"! #\u003cThread:0x0000eb7df3fc1388 /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1204gitlab # [ 224.913982] bundle[1978]: {"timestamp":"2026-08-13T15:57:52.787Z","pid":1978,"message":"Use Ctrl-C to stop"}1205gitlab # [ 224.917000] bundle[1978]: {"timestamp":"2026-08-13T15:57:52.788Z","pid":1978,"message":"Sending status to systemd every 1.0 sec"}1206gitlab # [ 225.035513] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:57:52.948Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"d526051cadb808ad1460402e","created_at":"2026-08-13T15:56:10.091Z","trace_propagation_headers":{"sentry-trace":"dff3e25dbbb648f493a27bb3c21e408c-ce2327ff89e54403","baggage":"sentry-trace_id=dff3e25dbbb648f493a27bb3c21e408c,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"48c0f0f8558118002204949bac84e566","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-13T15:56:10.103Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-d526051cadb808ad1460402e: done: 0.194948 sec","job_status":"done","queue_duration_s":102.650858,"scheduling_latency_s":102.650958,"redis_calls":24,"redis_duration_s":0.007904,"redis_read_bytes":912,"redis_write_bytes":2622,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.005216,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001541,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001147,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":9,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.092239,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.10947132,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.194948,"completed_at":"2026-08-13T15:57:52.948Z","load_balancing_strategy":"primary","db_duration_s":0.054492,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1207gitlab # [ 225.575736] bundle[1978]: {"timestamp":"2026-08-13T15:57:53.488Z","pid":1978,"message":"- Worker 0 (PID: 2902) booted in 0.66s, phase: 0"}1208gitlab # [ 225.588836] bundle[1978]: {"timestamp":"2026-08-13T15:57:53.502Z","pid":1978,"message":"- Worker 1 (PID: 2906) booted in 0.65s, phase: 0"}1209gitlab # [ 225.595602] systemd[1]: Started gitlab.service.1210gitlab # [ 225.597905] systemd[1]: Reached target Common target for all GitLab services..1211gitlab # [ 225.600975] systemd[1]: Starting setup-gitlab.service...1212gitlab # [ 225.644976] setup-gitlab-start[2940]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1213gitlab # [ 229.272082] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:15:57:57 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 35841214gitlab # [ 229.275766] setup-gitlab-start[2940]: + TOKEN=nixbot-test-token-of-20-chars1215gitlab # [ 229.278086] setup-gitlab-start[2940]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1216gitlab # [ 229.294652] runuser[2966]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1217gitlab # [ 229.821101] setup-gitlab-start[2967]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1218gitlab # [ 229.827890] setup-gitlab-start[2967]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1219gitlab # [ 229.834426] setup-gitlab-start[2967]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1220gitlab # [ 230.669941] setup-gitlab-start[2967]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1221gitlab # [ 230.670302] setup-gitlab-start[2967]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1222gitlab # [ 230.672829] setup-gitlab-start[2967]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1223gitlab # [ 235.866553] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:03.778Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"321d6f73f07f204025f614d5","created_at":"2026-08-13T15:58:03.666Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8c73be0248c534f1c2ea798ded13a588","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-13T15:58:03.773Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-321d6f73f07f204025f614d5: start","job_status":"start","queue_duration_s":0.004555,"scheduling_latency_s":0.004614}1224gitlab # [ 236.161925] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:04.074Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"321d6f73f07f204025f614d5","created_at":"2026-08-13T15:58:03.666Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8c73be0248c534f1c2ea798ded13a588","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-13T15:58:03.773Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-321d6f73f07f204025f614d5: done: 0.296081 sec","job_status":"done","queue_duration_s":0.004555,"scheduling_latency_s":0.004614,"redis_calls":12,"redis_duration_s":0.06510099999999999,"redis_read_bytes":11,"redis_write_bytes":1482,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.007105,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.054866,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00313,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0523,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00167434,"duration_s":0.296081,"completed_at":"2026-08-13T15:58:04.074Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.032341,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1225gitlab # [ 236.259200] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:04.083Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"9b62591fac6174c54ec3bce9","created_at":"2026-08-13T15:58:03.805Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7b656bf1eb58f168ed84f487a2076f5b","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-13T15:58:03.830Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-9b62591fac6174c54ec3bce9: start","job_status":"start","queue_duration_s":0.252711,"scheduling_latency_s":0.252761}1226gitlab # [ 236.320865] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:04.233Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"9b62591fac6174c54ec3bce9","created_at":"2026-08-13T15:58:03.805Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7b656bf1eb58f168ed84f487a2076f5b","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-13T15:58:03.830Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-9b62591fac6174c54ec3bce9: done: 0.149657 sec","job_status":"done","queue_duration_s":0.252711,"scheduling_latency_s":0.252761,"redis_calls":10,"redis_duration_s":0.021619,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000836,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.017303,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00348,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.034,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.034,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050514,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00109714,"duration_s":0.149657,"completed_at":"2026-08-13T15:58:04.233Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0501,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1227gitlab # [ 236.395335] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:04.237Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"7c1fee5bd853f3d54b050c98","created_at":"2026-08-13T15:58:03.852Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"90e9f8767d8b7ded52c739d52c82f9fb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-13T15:58:03.863Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-7c1fee5bd853f3d54b050c98: start","job_status":"start","queue_duration_s":0.37387,"scheduling_latency_s":0.373915}1228gitlab # [ 236.470218] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:04.382Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"7c1fee5bd853f3d54b050c98","created_at":"2026-08-13T15:58:03.852Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"90e9f8767d8b7ded52c739d52c82f9fb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-13T15:58:03.863Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-7c1fee5bd853f3d54b050c98: done: 0.145036 sec","job_status":"done","queue_duration_s":0.37387,"scheduling_latency_s":0.373915,"redis_calls":10,"redis_duration_s":0.038367,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004342,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.03099,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003035,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.061985,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00347076,"duration_s":0.145036,"completed_at":"2026-08-13T15:58:04.382Z","load_balancing_strategy":"primary","db_duration_s":0.01552,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1229gitlab # [ 236.560358] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:04.406Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"b7f6f57494021ed445c13fb8","created_at":"2026-08-13T15:58:03.885Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b15652dbc532ce049e4bfdd1a492e0b9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-13T15:58:03.911Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-b7f6f57494021ed445c13fb8: start","job_status":"start","queue_duration_s":0.495164,"scheduling_latency_s":0.495209}1230gitlab # [ 237.401275] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:05.313Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"b7f6f57494021ed445c13fb8","created_at":"2026-08-13T15:58:03.885Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b15652dbc532ce049e4bfdd1a492e0b9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-13T15:58:03.911Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-b7f6f57494021ed445c13fb8: done: 0.906871 sec","job_status":"done","queue_duration_s":0.495164,"scheduling_latency_s":0.495209,"redis_calls":14,"redis_duration_s":0.025249,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.008473,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.010768,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.006008,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.1,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.1,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.455413,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00289722,"exclusive_lock_hold_duration_s":0.7699009800000001,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.906871,"completed_at":"2026-08-13T15:58:05.313Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.245717,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1231gitlab # [ 237.404728] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:05.315Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"ee5749a9637e15ea5002eae7","created_at":"2026-08-13T15:58:03.932Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c90e6f92f71fed33ede5f8c5540e4842","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-13T15:58:03.947Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-ee5749a9637e15ea5002eae7: start","job_status":"start","queue_duration_s":1.36746,"scheduling_latency_s":1.367482}1232gitlab # [ 237.557250] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:05.469Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"ee5749a9637e15ea5002eae7","created_at":"2026-08-13T15:58:03.932Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c90e6f92f71fed33ede5f8c5540e4842","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-13T15:58:03.947Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-ee5749a9637e15ea5002eae7: done: 0.154631 sec","job_status":"done","queue_duration_s":1.36746,"scheduling_latency_s":1.367482,"redis_calls":13,"redis_duration_s":0.005431,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000778,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002937,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001716,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.091,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.091,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050455,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.02583608,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.154631,"completed_at":"2026-08-13T15:58:05.469Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.09076,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1233gitlab # [ 237.666995] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:05.473Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"5079cff4174cb4c071d6d5d7","created_at":"2026-08-13T15:58:03.961Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"99e5796dde8353353c43d5f73340753a","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-13T15:58:03.987Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-5079cff4174cb4c071d6d5d7: start","job_status":"start","queue_duration_s":1.486741,"scheduling_latency_s":1.486779}1234gitlab # [ 237.683493] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:05.536Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"5079cff4174cb4c071d6d5d7","created_at":"2026-08-13T15:58:03.961Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"99e5796dde8353353c43d5f73340753a","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-13T15:58:03.987Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-5079cff4174cb4c071d6d5d7: done: 0.062698 sec","job_status":"done","queue_duration_s":1.486741,"scheduling_latency_s":1.486779,"redis_calls":10,"redis_duration_s":0.004507,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000873,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002768,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000866,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03303,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00066128,"duration_s":0.062698,"completed_at":"2026-08-13T15:58:05.536Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013142,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1235gitlab # [ 237.730906] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:05.539Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"da72d8758ae1ad262ea0fa78","created_at":"2026-08-13T15:58:04.060Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1c2fd09fd14df7afeece4f38b2cc15b7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-13T15:58:04.081Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-da72d8758ae1ad262ea0fa78: start","job_status":"start","queue_duration_s":1.45768,"scheduling_latency_s":1.457716}1236gitlab # [ 237.747517] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:05.564Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1237gitlab # [ 237.751684] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:05.586Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"da72d8758ae1ad262ea0fa78","created_at":"2026-08-13T15:58:04.060Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1c2fd09fd14df7afeece4f38b2cc15b7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-13T15:58:04.081Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-da72d8758ae1ad262ea0fa78: done: 0.046976 sec","job_status":"done","queue_duration_s":1.45768,"scheduling_latency_s":1.457716,"redis_calls":10,"redis_duration_s":0.004021,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001018,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002228,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000775,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028626,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00071216,"duration_s":0.046976,"completed_at":"2026-08-13T15:58:05.586Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00097,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1238gitlab # [ 237.796383] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:05.590Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"452ef6f948f59d31525f8d4c","created_at":"2026-08-13T15:58:04.126Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b4d444cb764f870f2561ca3a6e173506","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-13T15:58:04.145Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-452ef6f948f59d31525f8d4c: start","job_status":"start","queue_duration_s":1.444797,"scheduling_latency_s":1.444841}1239gitlab # [ 237.810594] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:05.652Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"452ef6f948f59d31525f8d4c","created_at":"2026-08-13T15:58:04.126Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b4d444cb764f870f2561ca3a6e173506","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-13T15:58:04.145Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-452ef6f948f59d31525f8d4c: done: 0.061913 sec","job_status":"done","queue_duration_s":1.444797,"scheduling_latency_s":1.444841,"redis_calls":12,"redis_duration_s":0.005828000000000001,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00096,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002625,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002243,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037537,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0014987,"exclusive_lock_hold_duration_s":0.008667580000000001,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.061913,"completed_at":"2026-08-13T15:58:05.651Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00344,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1240gitlab # [ 237.855682] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:05.656Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"65d818f2a14403081e8c53e9","created_at":"2026-08-13T15:58:04.179Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"35142fdd8b86628a7b8ec4de40949aec","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-13T15:58:04.202Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-65d818f2a14403081e8c53e9: start","job_status":"start","queue_duration_s":1.453875,"scheduling_latency_s":1.453917}1241gitlab # [ 237.870375] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:05.682Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1242gitlab # [ 237.873996] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:05.698Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"65d818f2a14403081e8c53e9","created_at":"2026-08-13T15:58:04.179Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"35142fdd8b86628a7b8ec4de40949aec","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-13T15:58:04.202Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-65d818f2a14403081e8c53e9: done: 0.042921 sec","job_status":"done","queue_duration_s":1.453875,"scheduling_latency_s":1.453917,"redis_calls":10,"redis_duration_s":0.004481,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000851,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002654,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000976,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024198,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00094272,"duration_s":0.042921,"completed_at":"2026-08-13T15:58:05.698Z","load_balancing_strategy":"primary","db_duration_s":0.000917,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1243gitlab # [ 237.919585] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:05.701Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"5af11a9a7fe5adaa80cd143b","created_at":"2026-08-13T15:58:04.209Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6d2281047c21903bf738e5e6d9ef46b0","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-13T15:58:04.244Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-5af11a9a7fe5adaa80cd143b: start","job_status":"start","queue_duration_s":1.457319,"scheduling_latency_s":1.457354}1244gitlab # [ 237.939473] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:05.751Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"5af11a9a7fe5adaa80cd143b","created_at":"2026-08-13T15:58:04.209Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6d2281047c21903bf738e5e6d9ef46b0","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-13T15:58:04.244Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-5af11a9a7fe5adaa80cd143b: done: 0.050323 sec","job_status":"done","queue_duration_s":1.457319,"scheduling_latency_s":1.457354,"redis_calls":12,"redis_duration_s":0.005258,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000785,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002311,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002162,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028562,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0009039,"exclusive_lock_hold_duration_s":0.01155958,"duration_s":0.050323,"completed_at":"2026-08-13T15:58:05.751Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005539,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1245gitlab # [ 237.984640] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:05.754Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"97db4727df428661c236575e","created_at":"2026-08-13T15:58:04.286Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"29a717c14f39910640ab8abaeb6d70c3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-13T15:58:04.325Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-97db4727df428661c236575e: start","job_status":"start","queue_duration_s":1.429442,"scheduling_latency_s":1.429475}1246gitlab # [ 237.999276] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:05.777Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1247gitlab # [ 238.002683] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:05.788Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"97db4727df428661c236575e","created_at":"2026-08-13T15:58:04.286Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"29a717c14f39910640ab8abaeb6d70c3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-13T15:58:04.325Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-97db4727df428661c236575e: done: 0.033767 sec","job_status":"done","queue_duration_s":1.429442,"scheduling_latency_s":1.429475,"redis_calls":10,"redis_duration_s":0.002636,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.0006,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001484,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000552,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020322,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00035994,"duration_s":0.033767,"completed_at":"2026-08-13T15:58:05.788Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001003,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1248gitlab # [ 238.046564] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:05.790Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"a9365a0bb36946645e5a925a","created_at":"2026-08-13T15:58:04.354Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8930aa6b83eeeff1e661fc82d9a3ae04","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-13T15:58:04.378Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-a9365a0bb36946645e5a925a: start","job_status":"start","queue_duration_s":1.41202,"scheduling_latency_s":1.412046}1249gitlab # [ 238.061044] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:05.853Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"a9365a0bb36946645e5a925a","created_at":"2026-08-13T15:58:04.354Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8930aa6b83eeeff1e661fc82d9a3ae04","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-13T15:58:04.378Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-a9365a0bb36946645e5a925a: done: 0.062893 sec","job_status":"done","queue_duration_s":1.41202,"scheduling_latency_s":1.412046,"redis_calls":16,"redis_duration_s":0.00867,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.007077,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001088,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000505,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031763,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00030114,"duration_s":0.062893,"completed_at":"2026-08-13T15:58:05.853Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016399,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1250gitlab # [ 238.104513] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:05.855Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"81ee7905d5585f35730f284d","created_at":"2026-08-13T15:58:04.404Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c2ab1201695f36fd448be1712417da3e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-13T15:58:04.420Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-81ee7905d5585f35730f284d: start","job_status":"start","queue_duration_s":1.434781,"scheduling_latency_s":1.434804}1251gitlab # [ 238.119856] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:05.876Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"81ee7905d5585f35730f284d","created_at":"2026-08-13T15:58:04.404Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c2ab1201695f36fd448be1712417da3e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-13T15:58:04.420Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-81ee7905d5585f35730f284d: done: 0.021144 sec","job_status":"done","queue_duration_s":1.434781,"scheduling_latency_s":1.434804,"redis_calls":10,"redis_duration_s":0.0015660000000000001,"redis_read_bytes":9,"redis_write_bytes":1299,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000296,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000808,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000462,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012798,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025486,"duration_s":0.021144,"completed_at":"2026-08-13T15:58:05.876Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000654,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1252gitlab # [ 238.164546] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:05.877Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"8f89cbbcf9e7a8de8ddac3b3","created_at":"2026-08-13T15:58:04.442Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"38195c08d4323238524994e3bdbdfbd6","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-13T15:58:04.452Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-8f89cbbcf9e7a8de8ddac3b3: start","job_status":"start","queue_duration_s":1.425207,"scheduling_latency_s":1.425228}1253gitlab # [ 238.177993] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:05.927Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"8f89cbbcf9e7a8de8ddac3b3","created_at":"2026-08-13T15:58:04.442Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"38195c08d4323238524994e3bdbdfbd6","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-13T15:58:04.452Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-8f89cbbcf9e7a8de8ddac3b3: done: 0.050211 sec","job_status":"done","queue_duration_s":1.425207,"scheduling_latency_s":1.425228,"redis_calls":10,"redis_duration_s":0.001419,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000287,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000828,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000304,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017027,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002471,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.050211,"completed_at":"2026-08-13T15:58:05.927Z","load_balancing_strategy":"primary","db_duration_s":0.025904,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1254gitlab # [ 238.221259] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:05.929Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Gitlab::JiraImport::StuckJiraImportJobsWorker","jid":"ce66aa70d6539d9717a571eb","created_at":"2026-08-13T15:58:04.457Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bb3004e814a0a7ced56a6d7af5fca9df","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b9cf6c9b6c2f8fad80e08693d59af787bb65ad6ffe24ec5d0e1a669517566127","size_limiter":"validated","enqueued_at":"2026-08-13T15:58:04.477Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Gitlab::JiraImport::StuckJiraImportJobsWorker JID-ce66aa70d6539d9717a571eb: start","job_status":"start","queue_duration_s":1.451735,"scheduling_latency_s":1.451891}1255gitlab # [ 238.234988] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:05.961Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Gitlab::JiraImport::StuckJiraImportJobsWorker","jid":"ce66aa70d6539d9717a571eb","created_at":"2026-08-13T15:58:04.457Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bb3004e814a0a7ced56a6d7af5fca9df","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b9cf6c9b6c2f8fad80e08693d59af787bb65ad6ffe24ec5d0e1a669517566127","size_limiter":"validated","enqueued_at":"2026-08-13T15:58:04.477Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Gitlab::JiraImport::StuckJiraImportJobsWorker JID-ce66aa70d6539d9717a571eb: done: 0.031591 sec","job_status":"done","queue_duration_s":1.451735,"scheduling_latency_s":1.451891,"redis_calls":10,"redis_duration_s":0.001528,"redis_read_bytes":9,"redis_write_bytes":1187,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000326,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000865,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000337,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01862,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00027624,"duration_s":0.031591,"completed_at":"2026-08-13T15:58:05.960Z","load_balancing_strategy":"primary","db_duration_s":0.005904,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1256gitlab # [ 238.277473] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:05.962Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"d1facf28c48253efa60aa0b3","created_at":"2026-08-13T15:58:04.485Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"baded6e20ecfe5b04cf4c462304ef64f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-13T15:58:04.515Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-d1facf28c48253efa60aa0b3: start","job_status":"start","queue_duration_s":1.446963,"scheduling_latency_s":1.44698}1257gitlab # [ 238.292490] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.017Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"d1facf28c48253efa60aa0b3","created_at":"2026-08-13T15:58:04.485Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"baded6e20ecfe5b04cf4c462304ef64f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-13T15:58:04.515Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-d1facf28c48253efa60aa0b3: done: 0.054789 sec","job_status":"done","queue_duration_s":1.446963,"scheduling_latency_s":1.44698,"redis_calls":12,"redis_duration_s":0.002,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000299,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000917,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000784,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024586,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00055856,"exclusive_lock_hold_duration_s":0.022802000000000003,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.054789,"completed_at":"2026-08-13T15:58:06.017Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.022834,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1258gitlab # [ 238.338795] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.018Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"06b138b8dcc139f465dabdc0","created_at":"2026-08-13T15:58:04.533Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"83fcf2e72b236b9faadc63cac55112b2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-13T15:58:04.598Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-06b138b8dcc139f465dabdc0: start","job_status":"start","queue_duration_s":1.420378,"scheduling_latency_s":1.420401}1259gitlab # [ 238.353415] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.075Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"06b138b8dcc139f465dabdc0","created_at":"2026-08-13T15:58:04.533Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"83fcf2e72b236b9faadc63cac55112b2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-13T15:58:04.598Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-06b138b8dcc139f465dabdc0: done: 0.056774 sec","job_status":"done","queue_duration_s":1.420378,"scheduling_latency_s":1.420401,"redis_calls":14,"redis_duration_s":0.002271,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000648,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000844,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000779,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032017,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00057282,"exclusive_lock_hold_duration_s":0.03044362,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.056774,"completed_at":"2026-08-13T15:58:06.075Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018209,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1260gitlab # [ 238.398132] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.077Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"e24c5cc5f62b0ac4a38356e7","created_at":"2026-08-13T15:58:04.654Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-13T15:58:04.669Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-e24c5cc5f62b0ac4a38356e7: start","job_status":"start","queue_duration_s":1.407264,"scheduling_latency_s":1.407281}1261gitlab # [ 238.413245] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.195Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"e24c5cc5f62b0ac4a38356e7","created_at":"2026-08-13T15:58:04.654Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-13T15:58:04.669Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-e24c5cc5f62b0ac4a38356e7: done: 0.118713 sec","job_status":"done","queue_duration_s":1.407264,"scheduling_latency_s":1.407281,"redis_calls":71,"redis_duration_s":0.011281,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.00167,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000812,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.008331,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000468,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.105157,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025228,"duration_s":0.118713,"completed_at":"2026-08-13T15:58:06.195Z","load_balancing_strategy":"primary","db_duration_s":0.00323,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1262gitlab # [ 238.456721] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.197Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"6090f30ae58b968012b487ef","created_at":"2026-08-13T15:58:04.691Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"be776378f5298bf17e0e3752142d553e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-13T15:58:04.703Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-6090f30ae58b968012b487ef: start","job_status":"start","queue_duration_s":1.493518,"scheduling_latency_s":1.493536}1263gitlab # [ 238.471399] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.209Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1264gitlab # [ 238.475055] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.217Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"6090f30ae58b968012b487ef","created_at":"2026-08-13T15:58:04.691Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"be776378f5298bf17e0e3752142d553e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-13T15:58:04.703Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-6090f30ae58b968012b487ef: done: 0.020053 sec","job_status":"done","queue_duration_s":1.493518,"scheduling_latency_s":1.493536,"redis_calls":10,"redis_duration_s":0.00143,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.0003,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000796,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000334,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01181,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025064,"duration_s":0.020053,"completed_at":"2026-08-13T15:58:06.217Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000574,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1265gitlab # [ 238.519624] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.218Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"3a23ddae755b05c4cda5774b","created_at":"2026-08-13T15:58:04.710Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d1b6b7850e76b5de83cbed1936368c32","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-13T15:58:04.718Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-3a23ddae755b05c4cda5774b: start","job_status":"start","queue_duration_s":1.500074,"scheduling_latency_s":1.50009}1266gitlab # [ 238.537829] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.231Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1267gitlab # [ 238.541826] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.238Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"3a23ddae755b05c4cda5774b","created_at":"2026-08-13T15:58:04.710Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d1b6b7850e76b5de83cbed1936368c32","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-13T15:58:04.718Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-3a23ddae755b05c4cda5774b: done: 0.019929 sec","job_status":"done","queue_duration_s":1.500074,"scheduling_latency_s":1.50009,"redis_calls":10,"redis_duration_s":0.001376,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000288,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000782,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000306,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012455,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00027622,"duration_s":0.019929,"completed_at":"2026-08-13T15:58:06.238Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000488,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1268gitlab # [ 238.584990] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.239Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"44f63097b6f42e85a96a0d16","created_at":"2026-08-13T15:58:04.731Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"287ce3b443c05d1659038b7555f522f8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-13T15:58:04.755Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-44f63097b6f42e85a96a0d16: start","job_status":"start","queue_duration_s":1.484818,"scheduling_latency_s":1.484834}1269gitlab # [ 238.598627] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.268Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"44f63097b6f42e85a96a0d16","created_at":"2026-08-13T15:58:04.731Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"287ce3b443c05d1659038b7555f522f8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-13T15:58:04.755Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-44f63097b6f42e85a96a0d16: done: 0.028644 sec","job_status":"done","queue_duration_s":1.484818,"scheduling_latency_s":1.484834,"redis_calls":12,"redis_duration_s":0.001728,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000273,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000791,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000664,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016439,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00049348,"exclusive_lock_hold_duration_s":0.0095075,"duration_s":0.028644,"completed_at":"2026-08-13T15:58:06.268Z","load_balancing_strategy":"primary","db_duration_s":0.005485,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1270gitlab # [ 238.639874] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.269Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"ea1e682c680191133016f412","created_at":"2026-08-13T15:58:04.799Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"27066e1a8de7a6ee7df392b5d91640aa","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-13T15:58:04.811Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-ea1e682c680191133016f412: start","job_status":"start","queue_duration_s":1.457744,"scheduling_latency_s":1.457761}1271gitlab # [ 238.653377] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.290Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"ea1e682c680191133016f412","created_at":"2026-08-13T15:58:04.799Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"27066e1a8de7a6ee7df392b5d91640aa","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-13T15:58:04.811Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-ea1e682c680191133016f412: done: 0.020674 sec","job_status":"done","queue_duration_s":1.457744,"scheduling_latency_s":1.457761,"redis_calls":12,"redis_duration_s":0.0017360000000000001,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000385,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00029,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000773,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000288,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012836,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023608,"duration_s":0.020674,"completed_at":"2026-08-13T15:58:06.290Z","load_balancing_strategy":"primary","db_duration_s":0.000736,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1272gitlab # [ 238.696835] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.291Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"79191fb052570771298d23f7","created_at":"2026-08-13T15:58:04.854Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"25cbf0797183abf002e5d9b442cb09cd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-13T15:58:04.872Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-79191fb052570771298d23f7: start","job_status":"start","queue_duration_s":1.419135,"scheduling_latency_s":1.419153}1273gitlab # [ 238.710329] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.336Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"79191fb052570771298d23f7","created_at":"2026-08-13T15:58:04.854Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"25cbf0797183abf002e5d9b442cb09cd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-13T15:58:04.872Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-79191fb052570771298d23f7: done: 0.044235 sec","job_status":"done","queue_duration_s":1.419135,"scheduling_latency_s":1.419153,"redis_calls":19,"redis_duration_s":0.003357,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000746,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000285,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.00177,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000556,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031656,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036052,"duration_s":0.044235,"completed_at":"2026-08-13T15:58:06.336Z","load_balancing_strategy":"primary","db_duration_s":0.003823,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1274gitlab # [ 238.754901] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.337Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"d0bac6f444841e297f368b8b","created_at":"2026-08-13T15:58:04.905Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"247760c32636a838897b2437f1278352","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-13T15:58:04.930Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-d0bac6f444841e297f368b8b: start","job_status":"start","queue_duration_s":1.407215,"scheduling_latency_s":1.407279}1275gitlab # [ 238.768665] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.353Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1276gitlab # [ 238.772349] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.362Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"d0bac6f444841e297f368b8b","created_at":"2026-08-13T15:58:04.905Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"247760c32636a838897b2437f1278352","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-13T15:58:04.930Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-d0bac6f444841e297f368b8b: done: 0.024675 sec","job_status":"done","queue_duration_s":1.407215,"scheduling_latency_s":1.407279,"redis_calls":10,"redis_duration_s":0.001856,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000418,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001015,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000423,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014581,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031024,"duration_s":0.024675,"completed_at":"2026-08-13T15:58:06.362Z","load_balancing_strategy":"primary","db_duration_s":0.000895,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1277gitlab # [ 238.814336] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.364Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"f7dbeaa127052f657028da2c","created_at":"2026-08-13T15:58:04.986Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ab3fd083dfe03b7a1ff379cb56f0a92a","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-13T15:58:05.021Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-f7dbeaa127052f657028da2c: start","job_status":"start","queue_duration_s":1.342753,"scheduling_latency_s":1.342776}1278gitlab # [ 238.828814] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.723Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"f7dbeaa127052f657028da2c","created_at":"2026-08-13T15:58:04.986Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ab3fd083dfe03b7a1ff379cb56f0a92a","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-13T15:58:05.021Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-f7dbeaa127052f657028da2c: done: 0.359479 sec","job_status":"done","queue_duration_s":1.342753,"scheduling_latency_s":1.342776,"redis_calls":565,"redis_duration_s":0.06668500000000001,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000383,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00094,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.065362,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.330501,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00028318,"duration_s":0.359479,"completed_at":"2026-08-13T15:58:06.723Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000775,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1279gitlab # [ 238.871238] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.724Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8615904d79200dd469ead22","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8615904d79200dd469ead22: start","job_status":"start","queue_duration_s":0.538454,"scheduling_latency_s":0.538477}1280gitlab # [ 238.883692] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.749Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8615904d79200dd469ead22","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8615904d79200dd469ead22: done: 0.024478 sec","job_status":"done","queue_duration_s":0.538454,"scheduling_latency_s":0.538477,"redis_calls":16,"redis_duration_s":0.0026550000000000002,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000313,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000816,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001526,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015343,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024054,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024478,"completed_at":"2026-08-13T15:58:06.749Z","load_balancing_strategy":"primary","db_duration_s":0.001102,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1281gitlab # [ 238.926012] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.750Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4cc70b287fe3608a5973877b","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4cc70b287fe3608a5973877b: start","job_status":"start","queue_duration_s":0.564341,"scheduling_latency_s":0.564359}1282gitlab # [ 238.939898] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.767Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4cc70b287fe3608a5973877b","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4cc70b287fe3608a5973877b: done: 0.017022 sec","job_status":"done","queue_duration_s":0.564341,"scheduling_latency_s":0.564359,"redis_calls":13,"redis_duration_s":0.001701,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000627,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001074,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011673,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017022,"completed_at":"2026-08-13T15:58:06.767Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1283gitlab # [ 238.980170] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.769Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5de771c795539c9ffc8344d5","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5de771c795539c9ffc8344d5: start","job_status":"start","queue_duration_s":0.582542,"scheduling_latency_s":0.582559}1284gitlab # [ 238.993117] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.786Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5de771c795539c9ffc8344d5","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5de771c795539c9ffc8344d5: done: 0.01719 sec","job_status":"done","queue_duration_s":0.582542,"scheduling_latency_s":0.582559,"redis_calls":13,"redis_duration_s":0.0015079999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000542,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000966,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010643,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01719,"completed_at":"2026-08-13T15:58:06.786Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1285gitlab # [ 239.032494] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.787Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"26b3636fc84fbb72438dd685","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-26b3636fc84fbb72438dd685: start","job_status":"start","queue_duration_s":0.600903,"scheduling_latency_s":0.600919}1286gitlab # [ 239.044725] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.803Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"26b3636fc84fbb72438dd685","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-26b3636fc84fbb72438dd685: done: 0.015623 sec","job_status":"done","queue_duration_s":0.600903,"scheduling_latency_s":0.600919,"redis_calls":13,"redis_duration_s":0.001679,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000737,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000942,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010489,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015623,"completed_at":"2026-08-13T15:58:06.802Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1287gitlab # [ 239.084313] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.804Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0592090a5ca7ae8df99e1e2","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0592090a5ca7ae8df99e1e2: start","job_status":"start","queue_duration_s":0.617888,"scheduling_latency_s":0.617905}1288gitlab # [ 239.096965] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.819Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0592090a5ca7ae8df99e1e2","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0592090a5ca7ae8df99e1e2: done: 0.015555 sec","job_status":"done","queue_duration_s":0.617888,"scheduling_latency_s":0.617905,"redis_calls":13,"redis_duration_s":0.001491,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00094,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010585,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015555,"completed_at":"2026-08-13T15:58:06.819Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1289gitlab # [ 239.136048] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.821Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"213717955dfec3c1266c38a2","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-213717955dfec3c1266c38a2: start","job_status":"start","queue_duration_s":0.634824,"scheduling_latency_s":0.634844}1290gitlab # [ 239.149721] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.837Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"213717955dfec3c1266c38a2","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-213717955dfec3c1266c38a2: done: 0.016039 sec","job_status":"done","queue_duration_s":0.634824,"scheduling_latency_s":0.634844,"redis_calls":13,"redis_duration_s":0.0015999999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000584,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001016,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011042,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016039,"completed_at":"2026-08-13T15:58:06.837Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1291gitlab # [ 239.188902] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.838Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d88733c19c7fe15b8fd3b0fb","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d88733c19c7fe15b8fd3b0fb: start","job_status":"start","queue_duration_s":0.65228,"scheduling_latency_s":0.652297}1292gitlab # [ 239.201194] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.854Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d88733c19c7fe15b8fd3b0fb","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d88733c19c7fe15b8fd3b0fb: done: 0.01585 sec","job_status":"done","queue_duration_s":0.65228,"scheduling_latency_s":0.652297,"redis_calls":13,"redis_duration_s":0.001547,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000579,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000968,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011177,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01585,"completed_at":"2026-08-13T15:58:06.854Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1293gitlab # [ 239.241327] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.855Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"568f628331fc03c7fc056d72","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-568f628331fc03c7fc056d72: start","job_status":"start","queue_duration_s":0.669417,"scheduling_latency_s":0.669432}1294gitlab # [ 239.254228] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.871Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"568f628331fc03c7fc056d72","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-568f628331fc03c7fc056d72: done: 0.015734 sec","job_status":"done","queue_duration_s":0.669417,"scheduling_latency_s":0.669432,"redis_calls":13,"redis_duration_s":0.001565,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00058,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000985,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011034,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015734,"completed_at":"2026-08-13T15:58:06.871Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1295gitlab # [ 239.293521] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.872Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"48895f88b4261dbd4051e381","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-48895f88b4261dbd4051e381: start","job_status":"start","queue_duration_s":0.686411,"scheduling_latency_s":0.686427}1296gitlab # [ 239.305968] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.887Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"48895f88b4261dbd4051e381","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-48895f88b4261dbd4051e381: done: 0.014952 sec","job_status":"done","queue_duration_s":0.686411,"scheduling_latency_s":0.686427,"redis_calls":13,"redis_duration_s":0.0015170000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000562,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000955,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010567,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014952,"completed_at":"2026-08-13T15:58:06.887Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1297gitlab # [ 239.346108] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.889Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5242c256d18c72ed03a05dbb","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5242c256d18c72ed03a05dbb: start","job_status":"start","queue_duration_s":0.702662,"scheduling_latency_s":0.702678}1298gitlab # [ 239.358600] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.904Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5242c256d18c72ed03a05dbb","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5242c256d18c72ed03a05dbb: done: 0.01529 sec","job_status":"done","queue_duration_s":0.702662,"scheduling_latency_s":0.702678,"redis_calls":13,"redis_duration_s":0.001701,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000547,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001154,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01072,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01529,"completed_at":"2026-08-13T15:58:06.904Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1299gitlab # [ 239.397819] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.905Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f5fe4ca5efdd577168100a79","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f5fe4ca5efdd577168100a79: start","job_status":"start","queue_duration_s":0.719041,"scheduling_latency_s":0.719057}1300gitlab # [ 239.410273] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.920Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f5fe4ca5efdd577168100a79","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f5fe4ca5efdd577168100a79: done: 0.015453 sec","job_status":"done","queue_duration_s":0.719041,"scheduling_latency_s":0.719057,"redis_calls":13,"redis_duration_s":0.001699,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001165,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010628,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015453,"completed_at":"2026-08-13T15:58:06.920Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1301gitlab # [ 239.449921] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.922Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ee616362ae22b2f8d1a6ef3","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ee616362ae22b2f8d1a6ef3: start","job_status":"start","queue_duration_s":0.735683,"scheduling_latency_s":0.7357}1302gitlab # [ 239.462267] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.938Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ee616362ae22b2f8d1a6ef3","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ee616362ae22b2f8d1a6ef3: done: 0.016495 sec","job_status":"done","queue_duration_s":0.735683,"scheduling_latency_s":0.7357,"redis_calls":13,"redis_duration_s":0.001839,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000709,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00113,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011681,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016495,"completed_at":"2026-08-13T15:58:06.938Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1303gitlab # [ 239.501475] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.939Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e6949de9fb59c618fbc24ee2","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e6949de9fb59c618fbc24ee2: start","job_status":"start","queue_duration_s":0.753345,"scheduling_latency_s":0.753363}1304gitlab # [ 239.513992] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.955Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e6949de9fb59c618fbc24ee2","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e6949de9fb59c618fbc24ee2: done: 0.015436 sec","job_status":"done","queue_duration_s":0.753345,"scheduling_latency_s":0.753363,"redis_calls":13,"redis_duration_s":0.001837,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000716,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001121,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010573,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015436,"completed_at":"2026-08-13T15:58:06.955Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1305gitlab # [ 239.554857] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.956Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05f4ded87f5c027b58d95db6","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05f4ded87f5c027b58d95db6: start","job_status":"start","queue_duration_s":0.769925,"scheduling_latency_s":0.769942}1306gitlab # [ 239.567444] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.972Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05f4ded87f5c027b58d95db6","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05f4ded87f5c027b58d95db6: done: 0.015591 sec","job_status":"done","queue_duration_s":0.769925,"scheduling_latency_s":0.769942,"redis_calls":13,"redis_duration_s":0.0015500000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000561,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000989,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010714,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015591,"completed_at":"2026-08-13T15:58:06.971Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1307gitlab # [ 239.607528] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.973Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"06116bced748863fd909951a","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-06116bced748863fd909951a: start","job_status":"start","queue_duration_s":0.786836,"scheduling_latency_s":0.786852}1308gitlab # [ 239.620226] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.988Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"06116bced748863fd909951a","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-06116bced748863fd909951a: done: 0.015425 sec","job_status":"done","queue_duration_s":0.786836,"scheduling_latency_s":0.786852,"redis_calls":13,"redis_duration_s":0.0015170000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000567,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00095,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010764,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015425,"completed_at":"2026-08-13T15:58:06.988Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1309gitlab # [ 239.659114] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:06.990Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0bb4b315debebbf5450e8c4","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0bb4b315debebbf5450e8c4: start","job_status":"start","queue_duration_s":0.803542,"scheduling_latency_s":0.803558}1310gitlab # [ 239.671563] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.007Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0bb4b315debebbf5450e8c4","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0bb4b315debebbf5450e8c4: done: 0.017371 sec","job_status":"done","queue_duration_s":0.803542,"scheduling_latency_s":0.803558,"redis_calls":13,"redis_duration_s":0.001812,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000665,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001147,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012036,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017371,"completed_at":"2026-08-13T15:58:07.007Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1311gitlab # [ 239.710540] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.008Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f5f28fd0c0df72ea71ffca43","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f5f28fd0c0df72ea71ffca43: start","job_status":"start","queue_duration_s":0.82239,"scheduling_latency_s":0.822407}1312gitlab # [ 239.722989] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.024Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f5f28fd0c0df72ea71ffca43","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f5f28fd0c0df72ea71ffca43: done: 0.015513 sec","job_status":"done","queue_duration_s":0.82239,"scheduling_latency_s":0.822407,"redis_calls":13,"redis_duration_s":0.001558,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000571,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000987,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010954,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015513,"completed_at":"2026-08-13T15:58:07.024Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1313gitlab # [ 239.763287] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.025Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0b6935e88c41775adc9eebdc","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0b6935e88c41775adc9eebdc: start","job_status":"start","queue_duration_s":0.839293,"scheduling_latency_s":0.839331}1314gitlab # [ 239.775794] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.041Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0b6935e88c41775adc9eebdc","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0b6935e88c41775adc9eebdc: done: 0.015317 sec","job_status":"done","queue_duration_s":0.839293,"scheduling_latency_s":0.839331,"redis_calls":13,"redis_duration_s":0.0015279999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000978,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010885,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015317,"completed_at":"2026-08-13T15:58:07.041Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1315gitlab # [ 239.815900] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.042Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0042b5faefed7f2be09ce274","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0042b5faefed7f2be09ce274: start","job_status":"start","queue_duration_s":0.855909,"scheduling_latency_s":0.855928}1316gitlab # [ 239.828552] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.058Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0042b5faefed7f2be09ce274","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0042b5faefed7f2be09ce274: done: 0.015753 sec","job_status":"done","queue_duration_s":0.855909,"scheduling_latency_s":0.855928,"redis_calls":13,"redis_duration_s":0.001562,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00057,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000992,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011127,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015753,"completed_at":"2026-08-13T15:58:07.058Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1317gitlab # [ 239.868255] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.059Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"019aeadb1e27f2b777ea0b4c","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-019aeadb1e27f2b777ea0b4c: start","job_status":"start","queue_duration_s":0.873045,"scheduling_latency_s":0.873069}1318gitlab # [ 239.880740] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.075Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"019aeadb1e27f2b777ea0b4c","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-019aeadb1e27f2b777ea0b4c: done: 0.01636 sec","job_status":"done","queue_duration_s":0.873045,"scheduling_latency_s":0.873069,"redis_calls":13,"redis_duration_s":0.0016,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000606,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000994,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011475,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01636,"completed_at":"2026-08-13T15:58:07.075Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1319gitlab # [ 239.920902] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.077Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dce8aedd643dbca9f5eaa315","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dce8aedd643dbca9f5eaa315: start","job_status":"start","queue_duration_s":0.890487,"scheduling_latency_s":0.890503}1320gitlab # [ 239.958515] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.092Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dce8aedd643dbca9f5eaa315","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dce8aedd643dbca9f5eaa315: done: 0.015538 sec","job_status":"done","queue_duration_s":0.890487,"scheduling_latency_s":0.890503,"redis_calls":13,"redis_duration_s":0.001544,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000562,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000982,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010737,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015538,"completed_at":"2026-08-13T15:58:07.092Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1321gitlab # [ 240.053057] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.093Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a99455295de3b925762663d7","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a99455295de3b925762663d7: start","job_status":"start","queue_duration_s":0.907121,"scheduling_latency_s":0.907143}1322gitlab # [ 240.071297] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.109Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a99455295de3b925762663d7","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a99455295de3b925762663d7: done: 0.015697 sec","job_status":"done","queue_duration_s":0.907121,"scheduling_latency_s":0.907143,"redis_calls":13,"redis_duration_s":0.0017850000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000553,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001232,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010837,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015697,"completed_at":"2026-08-13T15:58:07.109Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1323gitlab # [ 240.115909] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.110Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cdb542dfb818fa1896250ae3","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cdb542dfb818fa1896250ae3: start","job_status":"start","queue_duration_s":0.923939,"scheduling_latency_s":0.923956}1324gitlab # [ 240.129057] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.127Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cdb542dfb818fa1896250ae3","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cdb542dfb818fa1896250ae3: done: 0.017345 sec","job_status":"done","queue_duration_s":0.923939,"scheduling_latency_s":0.923956,"redis_calls":13,"redis_duration_s":0.001635,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000629,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001006,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010865,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017345,"completed_at":"2026-08-13T15:58:07.127Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1325gitlab # [ 240.170182] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.129Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"35a958a1f93d3c52af42b6e3","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-35a958a1f93d3c52af42b6e3: start","job_status":"start","queue_duration_s":0.942517,"scheduling_latency_s":0.942535}1326gitlab # [ 240.183135] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.144Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"35a958a1f93d3c52af42b6e3","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-35a958a1f93d3c52af42b6e3: done: 0.015892 sec","job_status":"done","queue_duration_s":0.942517,"scheduling_latency_s":0.942535,"redis_calls":13,"redis_duration_s":0.00164,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000593,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001047,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010767,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015892,"completed_at":"2026-08-13T15:58:07.144Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1327gitlab # [ 240.223748] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.146Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d12695b5b7d45a5093f3705","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d12695b5b7d45a5093f3705: start","job_status":"start","queue_duration_s":0.959547,"scheduling_latency_s":0.959564}1328gitlab # [ 240.236877] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.161Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d12695b5b7d45a5093f3705","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d12695b5b7d45a5093f3705: done: 0.015288 sec","job_status":"done","queue_duration_s":0.959547,"scheduling_latency_s":0.959564,"redis_calls":13,"redis_duration_s":0.001513,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000552,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000961,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010481,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015288,"completed_at":"2026-08-13T15:58:07.161Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1329gitlab # [ 240.277309] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.162Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ea75a75eeb8b5b890688395","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ea75a75eeb8b5b890688395: start","job_status":"start","queue_duration_s":0.97609,"scheduling_latency_s":0.976107}1330gitlab # [ 240.290005] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.178Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ea75a75eeb8b5b890688395","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ea75a75eeb8b5b890688395: done: 0.015775 sec","job_status":"done","queue_duration_s":0.97609,"scheduling_latency_s":0.976107,"redis_calls":13,"redis_duration_s":0.0016749999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000674,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001001,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010964,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015775,"completed_at":"2026-08-13T15:58:07.178Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1331gitlab # [ 240.330442] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.179Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b1349c86c2af057112982ff","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b1349c86c2af057112982ff: start","job_status":"start","queue_duration_s":0.99321,"scheduling_latency_s":0.993226}1332gitlab # [ 240.343231] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.195Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b1349c86c2af057112982ff","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b1349c86c2af057112982ff: done: 0.015754 sec","job_status":"done","queue_duration_s":0.99321,"scheduling_latency_s":0.993226,"redis_calls":13,"redis_duration_s":0.001597,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000596,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001001,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011124,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015754,"completed_at":"2026-08-13T15:58:07.195Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1333gitlab # [ 240.384222] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.197Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa8fe4a8cc6d7acea865ad6d","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa8fe4a8cc6d7acea865ad6d: start","job_status":"start","queue_duration_s":1.010565,"scheduling_latency_s":1.010581}1334gitlab # [ 240.396818] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.212Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa8fe4a8cc6d7acea865ad6d","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa8fe4a8cc6d7acea865ad6d: done: 0.015712 sec","job_status":"done","queue_duration_s":1.010565,"scheduling_latency_s":1.010581,"redis_calls":13,"redis_duration_s":0.002039,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000989,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00105,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010917,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015712,"completed_at":"2026-08-13T15:58:07.212Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1335gitlab # [ 240.436538] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.214Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cfcdf3c03e6223fabe4fbc37","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cfcdf3c03e6223fabe4fbc37: start","job_status":"start","queue_duration_s":1.027528,"scheduling_latency_s":1.027545}1336gitlab # [ 240.448807] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.229Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cfcdf3c03e6223fabe4fbc37","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cfcdf3c03e6223fabe4fbc37: done: 0.015362 sec","job_status":"done","queue_duration_s":1.027528,"scheduling_latency_s":1.027545,"redis_calls":13,"redis_duration_s":0.0016350000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000569,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001066,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010945,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015362,"completed_at":"2026-08-13T15:58:07.229Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1337gitlab # [ 240.488658] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.231Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31683426e61637b2e4b1ad68","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31683426e61637b2e4b1ad68: start","job_status":"start","queue_duration_s":1.044777,"scheduling_latency_s":1.044794}1338gitlab # [ 240.500966] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.246Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31683426e61637b2e4b1ad68","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31683426e61637b2e4b1ad68: done: 0.015043 sec","job_status":"done","queue_duration_s":1.044777,"scheduling_latency_s":1.044794,"redis_calls":13,"redis_duration_s":0.0014889999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000938,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010596,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015043,"completed_at":"2026-08-13T15:58:07.246Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1339gitlab # [ 240.540543] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.247Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5321de87d082887f79f17be8","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5321de87d082887f79f17be8: start","job_status":"start","queue_duration_s":1.06116,"scheduling_latency_s":1.061176}1340gitlab # [ 240.552723] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.263Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5321de87d082887f79f17be8","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5321de87d082887f79f17be8: done: 0.016177 sec","job_status":"done","queue_duration_s":1.06116,"scheduling_latency_s":1.061176,"redis_calls":13,"redis_duration_s":0.0016419999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000561,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001081,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011188,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016177,"completed_at":"2026-08-13T15:58:07.263Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1341gitlab # [ 240.593272] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.265Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c38cd324aba557689c694c4","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c38cd324aba557689c694c4: start","job_status":"start","queue_duration_s":1.078488,"scheduling_latency_s":1.078507}1342gitlab # [ 240.605888] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.280Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c38cd324aba557689c694c4","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c38cd324aba557689c694c4: done: 0.015552 sec","job_status":"done","queue_duration_s":1.078488,"scheduling_latency_s":1.078507,"redis_calls":13,"redis_duration_s":0.001601,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000581,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00102,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010893,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015552,"completed_at":"2026-08-13T15:58:07.280Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1343gitlab # [ 240.645486] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.281Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2a698c67f0ebc3f49b5ec11","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2a698c67f0ebc3f49b5ec11: start","job_status":"start","queue_duration_s":1.095197,"scheduling_latency_s":1.095213}1344gitlab # [ 240.657941] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.297Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2a698c67f0ebc3f49b5ec11","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2a698c67f0ebc3f49b5ec11: done: 0.015679 sec","job_status":"done","queue_duration_s":1.095197,"scheduling_latency_s":1.095213,"redis_calls":13,"redis_duration_s":0.00159,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000567,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001023,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010792,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015679,"completed_at":"2026-08-13T15:58:07.297Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1345gitlab # [ 240.697410] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.298Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac90e143b51c98c953699ab0","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac90e143b51c98c953699ab0: start","job_status":"start","queue_duration_s":1.112069,"scheduling_latency_s":1.112088}1346gitlab # [ 240.709968] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.314Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac90e143b51c98c953699ab0","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac90e143b51c98c953699ab0: done: 0.016108 sec","job_status":"done","queue_duration_s":1.112069,"scheduling_latency_s":1.112088,"redis_calls":13,"redis_duration_s":0.001753,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000796,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000957,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010857,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016108,"completed_at":"2026-08-13T15:58:07.314Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1347gitlab # [ 240.749494] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.315Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b16b4e42746bfc252c92cdae","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b16b4e42746bfc252c92cdae: start","job_status":"start","queue_duration_s":1.129314,"scheduling_latency_s":1.129331}1348gitlab # [ 240.761806] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.331Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b16b4e42746bfc252c92cdae","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b16b4e42746bfc252c92cdae: done: 0.015748 sec","job_status":"done","queue_duration_s":1.129314,"scheduling_latency_s":1.129331,"redis_calls":13,"redis_duration_s":0.001592,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000593,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000999,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010884,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015748,"completed_at":"2026-08-13T15:58:07.331Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1349gitlab # [ 240.802519] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.332Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cfcae383a92fe778f74e8a93","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cfcae383a92fe778f74e8a93: start","job_status":"start","queue_duration_s":1.146181,"scheduling_latency_s":1.146198}1350gitlab # [ 240.815099] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.348Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cfcae383a92fe778f74e8a93","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cfcae383a92fe778f74e8a93: done: 0.015371 sec","job_status":"done","queue_duration_s":1.146181,"scheduling_latency_s":1.146198,"redis_calls":13,"redis_duration_s":0.001539,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000553,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000986,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010588,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015371,"completed_at":"2026-08-13T15:58:07.348Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1351gitlab # [ 240.854787] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.349Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04e50992febc9d126023425c","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04e50992febc9d126023425c: start","job_status":"start","queue_duration_s":1.162858,"scheduling_latency_s":1.162875}1352gitlab # [ 240.867559] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.364Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04e50992febc9d126023425c","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04e50992febc9d126023425c: done: 0.015398 sec","job_status":"done","queue_duration_s":1.162858,"scheduling_latency_s":1.162875,"redis_calls":13,"redis_duration_s":0.0015149999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000964,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010641,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015398,"completed_at":"2026-08-13T15:58:07.364Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1353gitlab # [ 240.907892] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.366Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de16cc2c7416f9ace452150e","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de16cc2c7416f9ace452150e: start","job_status":"start","queue_duration_s":1.179569,"scheduling_latency_s":1.179585}1354gitlab # [ 240.921210] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.381Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de16cc2c7416f9ace452150e","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de16cc2c7416f9ace452150e: done: 0.015052 sec","job_status":"done","queue_duration_s":1.179569,"scheduling_latency_s":1.179585,"redis_calls":13,"redis_duration_s":0.00151,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000569,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000941,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010606,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015052,"completed_at":"2026-08-13T15:58:07.381Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1355gitlab # [ 240.961574] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.382Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"93a5fc25fd78fe57680f540e","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-93a5fc25fd78fe57680f540e: start","job_status":"start","queue_duration_s":1.195893,"scheduling_latency_s":1.19591}1356gitlab # [ 240.974364] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.397Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"93a5fc25fd78fe57680f540e","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-93a5fc25fd78fe57680f540e: done: 0.015508 sec","job_status":"done","queue_duration_s":1.195893,"scheduling_latency_s":1.19591,"redis_calls":13,"redis_duration_s":0.0015990000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000563,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001036,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010947,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015508,"completed_at":"2026-08-13T15:58:07.397Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1357gitlab # [ 241.016139] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.399Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b224c634989fd51fb9e167b5","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b224c634989fd51fb9e167b5: start","job_status":"start","queue_duration_s":1.212954,"scheduling_latency_s":1.212971}1358gitlab # [ 241.028784] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.414Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b224c634989fd51fb9e167b5","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b224c634989fd51fb9e167b5: done: 0.015455 sec","job_status":"done","queue_duration_s":1.212954,"scheduling_latency_s":1.212971,"redis_calls":13,"redis_duration_s":0.001752,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000589,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001163,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010769,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015455,"completed_at":"2026-08-13T15:58:07.414Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1359gitlab # [ 241.069198] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.416Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a2151ac9e411b6fd60d49857","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a2151ac9e411b6fd60d49857: start","job_status":"start","queue_duration_s":1.229862,"scheduling_latency_s":1.229879}1360gitlab # [ 241.082058] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.432Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a2151ac9e411b6fd60d49857","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a2151ac9e411b6fd60d49857: done: 0.015664 sec","job_status":"done","queue_duration_s":1.229862,"scheduling_latency_s":1.229879,"redis_calls":13,"redis_duration_s":0.0015730000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001023,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011075,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015664,"completed_at":"2026-08-13T15:58:07.431Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1361gitlab # [ 241.122402] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.433Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"88d247037f1f0cd68365e366","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-88d247037f1f0cd68365e366: start","job_status":"start","queue_duration_s":1.246658,"scheduling_latency_s":1.246674}1362gitlab # [ 241.134937] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.448Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"88d247037f1f0cd68365e366","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-88d247037f1f0cd68365e366: done: 0.015534 sec","job_status":"done","queue_duration_s":1.246658,"scheduling_latency_s":1.246674,"redis_calls":13,"redis_duration_s":0.00172,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001176,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010825,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015534,"completed_at":"2026-08-13T15:58:07.448Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1363gitlab # [ 241.174386] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.449Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f9c515dedb3faedeaf813ec","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f9c515dedb3faedeaf813ec: start","job_status":"start","queue_duration_s":1.263331,"scheduling_latency_s":1.263347}1364gitlab # [ 241.188220] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.465Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f9c515dedb3faedeaf813ec","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f9c515dedb3faedeaf813ec: done: 0.015597 sec","job_status":"done","queue_duration_s":1.263331,"scheduling_latency_s":1.263347,"redis_calls":13,"redis_duration_s":0.001558,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000557,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001001,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010608,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015597,"completed_at":"2026-08-13T15:58:07.465Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1365gitlab # [ 241.228301] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.466Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c89c6b55f22dce7ac047196a","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c89c6b55f22dce7ac047196a: start","job_status":"start","queue_duration_s":1.28028,"scheduling_latency_s":1.280297}1366gitlab # [ 241.240811] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.482Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c89c6b55f22dce7ac047196a","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c89c6b55f22dce7ac047196a: done: 0.015899 sec","job_status":"done","queue_duration_s":1.28028,"scheduling_latency_s":1.280297,"redis_calls":13,"redis_duration_s":0.0016879999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000558,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00113,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010692,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015899,"completed_at":"2026-08-13T15:58:07.482Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1367gitlab # [ 241.280506] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.483Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f22c80d3168f43c781a52d8e","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f22c80d3168f43c781a52d8e: start","job_status":"start","queue_duration_s":1.29739,"scheduling_latency_s":1.297407}1368gitlab # [ 241.292861] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.499Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f22c80d3168f43c781a52d8e","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f22c80d3168f43c781a52d8e: done: 0.015486 sec","job_status":"done","queue_duration_s":1.29739,"scheduling_latency_s":1.297407,"redis_calls":13,"redis_duration_s":0.0015899999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000627,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000963,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010662,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015486,"completed_at":"2026-08-13T15:58:07.499Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1369gitlab # [ 241.332954] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.500Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d4078e2e33e0c960ad0991b","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d4078e2e33e0c960ad0991b: start","job_status":"start","queue_duration_s":1.313998,"scheduling_latency_s":1.314014}1370gitlab # [ 241.345751] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.515Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d4078e2e33e0c960ad0991b","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d4078e2e33e0c960ad0991b: done: 0.015303 sec","job_status":"done","queue_duration_s":1.313998,"scheduling_latency_s":1.314014,"redis_calls":13,"redis_duration_s":0.001863,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000721,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001142,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010487,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015303,"completed_at":"2026-08-13T15:58:07.515Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1371gitlab # [ 241.386604] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.517Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b2f9ca44e207b946aacc10bc","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b2f9ca44e207b946aacc10bc: start","job_status":"start","queue_duration_s":1.330637,"scheduling_latency_s":1.330654}1372gitlab # [ 241.399360] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.533Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b2f9ca44e207b946aacc10bc","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b2f9ca44e207b946aacc10bc: done: 0.016162 sec","job_status":"done","queue_duration_s":1.330637,"scheduling_latency_s":1.330654,"redis_calls":13,"redis_duration_s":0.001659,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000593,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001066,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011096,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016162,"completed_at":"2026-08-13T15:58:07.533Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1373gitlab # [ 241.439747] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.534Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c461cd61cc7f9c3ad1cf8540","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c461cd61cc7f9c3ad1cf8540: start","job_status":"start","queue_duration_s":1.34814,"scheduling_latency_s":1.348157}1374gitlab # [ 241.452638] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.549Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c461cd61cc7f9c3ad1cf8540","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c461cd61cc7f9c3ad1cf8540: done: 0.015324 sec","job_status":"done","queue_duration_s":1.34814,"scheduling_latency_s":1.348157,"redis_calls":13,"redis_duration_s":0.0015760000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000558,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001018,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010784,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015324,"completed_at":"2026-08-13T15:58:07.549Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1375gitlab # [ 241.492643] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.551Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7c5ebf990d6f430baee3b002","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7c5ebf990d6f430baee3b002: start","job_status":"start","queue_duration_s":1.364855,"scheduling_latency_s":1.364872}1376gitlab # [ 241.505169] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.566Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7c5ebf990d6f430baee3b002","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7c5ebf990d6f430baee3b002: done: 0.015457 sec","job_status":"done","queue_duration_s":1.364855,"scheduling_latency_s":1.364872,"redis_calls":13,"redis_duration_s":0.0015480000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000564,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000984,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011025,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015457,"completed_at":"2026-08-13T15:58:07.566Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1377gitlab # [ 241.544944] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.568Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"092dbcaacfe9c0452bd60767","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-092dbcaacfe9c0452bd60767: start","job_status":"start","queue_duration_s":1.381587,"scheduling_latency_s":1.381604}1378gitlab # [ 241.557549] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.583Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"092dbcaacfe9c0452bd60767","created_at":"2026-08-13T15:58:06.101Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-3dae83762bee43fd","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0d9d53561d7ea18b648f48f9e8a137a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.186Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-092dbcaacfe9c0452bd60767: done: 0.015626 sec","job_status":"done","queue_duration_s":1.381587,"scheduling_latency_s":1.381604,"redis_calls":13,"redis_duration_s":0.001555,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010855,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015626,"completed_at":"2026-08-13T15:58:07.583Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1379gitlab # [ 241.598853] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.585Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"124506768067bf410a91de0f","created_at":"2026-08-13T15:58:06.311Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-473a98a623514a16","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"25cbf0797183abf002e5d9b442cb09cd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.326Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-124506768067bf410a91de0f: start","job_status":"start","queue_duration_s":1.25817,"scheduling_latency_s":1.258187}1380gitlab # [ 241.611557] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.604Z","message":"No existing merge request to be cleaned up."}1381gitlab # [ 241.613416] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.620Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"124506768067bf410a91de0f","created_at":"2026-08-13T15:58:06.311Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-473a98a623514a16","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"25cbf0797183abf002e5d9b442cb09cd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.326Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-124506768067bf410a91de0f: done: 0.035069 sec","job_status":"done","queue_duration_s":1.25817,"scheduling_latency_s":1.258187,"redis_calls":13,"redis_duration_s":0.0018449999999999999,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000313,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000691,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000841,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022275,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026162,"duration_s":0.035069,"completed_at":"2026-08-13T15:58:07.620Z","load_balancing_strategy":"primary","db_duration_s":0.006567,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1382gitlab # [ 241.654698] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.621Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8de0df2a945f1f0444e9237d","created_at":"2026-08-13T15:58:06.311Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-473a98a623514a16","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"25cbf0797183abf002e5d9b442cb09cd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.326Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8de0df2a945f1f0444e9237d: start","job_status":"start","queue_duration_s":1.294417,"scheduling_latency_s":1.294434}1383gitlab # [ 241.667202] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.633Z","message":"No existing merge request to be cleaned up."}1384gitlab # [ 241.668952] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.642Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8de0df2a945f1f0444e9237d","created_at":"2026-08-13T15:58:06.311Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-473a98a623514a16","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"25cbf0797183abf002e5d9b442cb09cd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.326Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8de0df2a945f1f0444e9237d: done: 0.020687 sec","job_status":"done","queue_duration_s":1.294417,"scheduling_latency_s":1.294434,"redis_calls":10,"redis_duration_s":0.001484,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000659,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000825,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014223,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020687,"completed_at":"2026-08-13T15:58:07.641Z","load_balancing_strategy":"primary","db_duration_s":0.00279,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1385gitlab # [ 241.707777] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.643Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b34fb2395fbd67ea1925073b","created_at":"2026-08-13T15:58:06.311Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-473a98a623514a16","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"25cbf0797183abf002e5d9b442cb09cd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.326Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b34fb2395fbd67ea1925073b: start","job_status":"start","queue_duration_s":1.316247,"scheduling_latency_s":1.316264}1386gitlab # [ 241.720542] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.654Z","message":"No existing merge request to be cleaned up."}1387gitlab # [ 241.722252] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.664Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b34fb2395fbd67ea1925073b","created_at":"2026-08-13T15:58:06.311Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-473a98a623514a16","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"25cbf0797183abf002e5d9b442cb09cd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.326Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b34fb2395fbd67ea1925073b: done: 0.021084 sec","job_status":"done","queue_duration_s":1.316247,"scheduling_latency_s":1.316264,"redis_calls":10,"redis_duration_s":0.001577,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000706,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000871,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014717,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021084,"completed_at":"2026-08-13T15:58:07.664Z","load_balancing_strategy":"primary","db_duration_s":0.002599,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1388gitlab # [ 241.762081] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.665Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"624484ffcf3abaa638d31347","created_at":"2026-08-13T15:58:06.311Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-473a98a623514a16","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"25cbf0797183abf002e5d9b442cb09cd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.326Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-624484ffcf3abaa638d31347: start","job_status":"start","queue_duration_s":1.338531,"scheduling_latency_s":1.338564}1389gitlab # [ 241.774851] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.677Z","message":"No existing merge request to be cleaned up."}1390gitlab # [ 241.776568] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:58:07.685Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"624484ffcf3abaa638d31347","created_at":"2026-08-13T15:58:06.311Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-473a98a623514a16","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"25cbf0797183abf002e5d9b442cb09cd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:58:06.326Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-624484ffcf3abaa638d31347: done: 0.020399 sec","job_status":"done","queue_duration_s":1.338531,"scheduling_latency_s":1.338564,"redis_calls":10,"redis_duration_s":0.001472,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00061,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000862,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014052,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020399,"completed_at":"2026-08-13T15:58:07.685Z","load_balancing_strategy":"primary","db_duration_s":0.00262,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1391gitlab # [ 273.178327] setup-gitlab-start[2967]: W, [2026-08-13T15:58:41.090859 #2967] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1392gitlab # [ 293.393835] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:01.305Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"1bd830b671495208f8e48fa1","created_at":"2026-08-13T15:59:01.281Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e4d6182ccd9f1e6803c348ee9954e81a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:01.300Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-1bd830b671495208f8e48fa1: start","job_status":"start","queue_duration_s":0.005069,"scheduling_latency_s":0.005119}1393gitlab # [ 293.610291] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:01.522Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"1bd830b671495208f8e48fa1","created_at":"2026-08-13T15:59:01.281Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e4d6182ccd9f1e6803c348ee9954e81a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:01.300Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-1bd830b671495208f8e48fa1: done: 0.217107 sec","job_status":"done","queue_duration_s":0.005069,"scheduling_latency_s":0.005119,"redis_calls":14,"redis_duration_s":0.071919,"redis_read_bytes":901,"redis_write_bytes":1246,"redis_feature_flag_calls":7,"redis_feature_flag_duration_s":0.015648,"redis_feature_flag_read_bytes":896,"redis_feature_flag_write_bytes":470,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.053933,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002338,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039093,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.217107,"completed_at":"2026-08-13T15:59:01.522Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1394gitlab # [ 293.709157] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:01.532Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"a47f4828aed17b001a62a3f9","created_at":"2026-08-13T15:59:01.350Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f40b25e67f4e10b78cac0f6fbc5299a2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-13T15:59:01.356Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-a47f4828aed17b001a62a3f9: start","job_status":"start","queue_duration_s":0.176077,"scheduling_latency_s":0.176124}1395gitlab # [ 293.749366] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:01.661Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"a47f4828aed17b001a62a3f9","created_at":"2026-08-13T15:59:01.350Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f40b25e67f4e10b78cac0f6fbc5299a2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-13T15:59:01.356Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-a47f4828aed17b001a62a3f9: done: 0.128744 sec","job_status":"done","queue_duration_s":0.176077,"scheduling_latency_s":0.176124,"redis_calls":7,"redis_duration_s":0.030019,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.026648,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003371,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042973,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.128744,"completed_at":"2026-08-13T15:59:01.661Z","load_balancing_strategy":"primary","db_duration_s":0.010683,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1396gitlab # [ 293.827689] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:01.684Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"df5885edccccaae721bd57e4","created_at":"2026-08-13T15:59:01.369Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c73ae66ab49827697cfdd3e6089b6b92","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:01.374Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-df5885edccccaae721bd57e4: start","job_status":"start","queue_duration_s":0.30965,"scheduling_latency_s":0.309695}1397gitlab # [ 294.427914] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:02.340Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"df5885edccccaae721bd57e4","created_at":"2026-08-13T15:59:01.369Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c73ae66ab49827697cfdd3e6089b6b92","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:01.374Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-df5885edccccaae721bd57e4: done: 0.656396 sec","job_status":"done","queue_duration_s":0.30965,"scheduling_latency_s":0.309695,"redis_calls":9,"redis_duration_s":0.008576,"redis_read_bytes":7,"redis_write_bytes":987,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005637,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002939,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":129,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":129,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.127,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.127,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.325657,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00200238,"exclusive_lock_hold_duration_s":0.55167476,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.656396,"completed_at":"2026-08-13T15:59:02.340Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.335412,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1398gitlab # [ 294.473000] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:02.348Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"4fd62fb336d269d6bea9fb00","created_at":"2026-08-13T15:59:01.390Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b45c9d9b9e20120566c89e0d31db09b5","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:01.408Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-4fd62fb336d269d6bea9fb00: start","job_status":"start","queue_duration_s":0.940055,"scheduling_latency_s":0.940104}1399gitlab # [ 294.493227] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:02.405Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"4fd62fb336d269d6bea9fb00","created_at":"2026-08-13T15:59:01.390Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b45c9d9b9e20120566c89e0d31db09b5","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:01.408Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-4fd62fb336d269d6bea9fb00: done: 0.057013 sec","job_status":"done","queue_duration_s":0.940055,"scheduling_latency_s":0.940104,"redis_calls":11,"redis_duration_s":0.005163,"redis_read_bytes":136,"redis_write_bytes":1288,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.00036,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":49,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001803,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038836,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01364248,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.057013,"completed_at":"2026-08-13T15:59:02.405Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004985,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1400gitlab # [ 294.537787] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:02.408Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"0bd72d69571e6fa637e13246","created_at":"2026-08-13T15:59:01.435Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f684ec7ddd5b99622a9cf8cd134aa4cf","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:01.449Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-0bd72d69571e6fa637e13246: start","job_status":"start","queue_duration_s":0.959488,"scheduling_latency_s":0.959526}1401gitlab # [ 294.552273] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:02.439Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"0bd72d69571e6fa637e13246","created_at":"2026-08-13T15:59:01.435Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f684ec7ddd5b99622a9cf8cd134aa4cf","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:01.449Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-0bd72d69571e6fa637e13246: done: 0.030391 sec","job_status":"done","queue_duration_s":0.959488,"scheduling_latency_s":0.959526,"redis_calls":7,"redis_duration_s":0.001976,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001442,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000534,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018529,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030391,"completed_at":"2026-08-13T15:59:02.439Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00176,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1402gitlab # [ 294.592850] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:02.441Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"66dc40578a143816be5d3544","created_at":"2026-08-13T15:59:01.507Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c97a38df07d826581b245c138f2f0f9d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:01.516Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-66dc40578a143816be5d3544: start","job_status":"start","queue_duration_s":0.924448,"scheduling_latency_s":0.924478}1403gitlab # [ 294.607633] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:02.456Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1404gitlab # [ 294.611612] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:02.464Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"66dc40578a143816be5d3544","created_at":"2026-08-13T15:59:01.507Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c97a38df07d826581b245c138f2f0f9d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:01.516Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-66dc40578a143816be5d3544: done: 0.023337 sec","job_status":"done","queue_duration_s":0.924448,"scheduling_latency_s":0.924478,"redis_calls":7,"redis_duration_s":0.0017000000000000001,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001214,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000486,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014982,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023337,"completed_at":"2026-08-13T15:59:02.464Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1405gitlab # [ 294.654333] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:02.466Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"4a67a107b9bdd3403bbe5e63","created_at":"2026-08-13T15:59:01.530Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b6078b8c322865da1baeab0e820f38ce","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:01.541Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-4a67a107b9bdd3403bbe5e63: start","job_status":"start","queue_duration_s":0.924835,"scheduling_latency_s":0.924861}1406gitlab # [ 294.669051] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:02.489Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"4a67a107b9bdd3403bbe5e63","created_at":"2026-08-13T15:59:01.530Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b6078b8c322865da1baeab0e820f38ce","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:01.541Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-4a67a107b9bdd3403bbe5e63: done: 0.023097 sec","job_status":"done","queue_duration_s":0.924835,"scheduling_latency_s":0.924861,"redis_calls":9,"redis_duration_s":0.001789,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000969,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00082,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014248,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0006294,"exclusive_lock_hold_duration_s":0.00382744,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.023097,"completed_at":"2026-08-13T15:59:02.489Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001752,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1407gitlab # [ 294.711507] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:02.491Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"1e1ec95f80dce565f66fdefb","created_at":"2026-08-13T15:59:01.585Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b8b0cc1519f95365d427867c7b4a6a28","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-13T15:59:01.616Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-1e1ec95f80dce565f66fdefb: start","job_status":"start","queue_duration_s":0.875125,"scheduling_latency_s":0.875146}1408gitlab # [ 294.725392] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:02.501Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1409gitlab # [ 294.728654] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:02.508Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"1e1ec95f80dce565f66fdefb","created_at":"2026-08-13T15:59:01.585Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b8b0cc1519f95365d427867c7b4a6a28","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-13T15:59:01.616Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-1e1ec95f80dce565f66fdefb: done: 0.017051 sec","job_status":"done","queue_duration_s":0.875125,"scheduling_latency_s":0.875146,"redis_calls":7,"redis_duration_s":0.0013059999999999999,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000959,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000347,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011115,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017051,"completed_at":"2026-08-13T15:59:02.508Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1410gitlab # [ 294.769075] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:02.510Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"363021d0373f367817064d1f","created_at":"2026-08-13T15:59:01.650Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ccc733a91b292cbe0428722b0d7a35df","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:01.657Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-363021d0373f367817064d1f: start","job_status":"start","queue_duration_s":0.852944,"scheduling_latency_s":0.852966}1411gitlab # [ 294.783390] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:02.519Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1412gitlab # [ 294.786758] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:02.526Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"363021d0373f367817064d1f","created_at":"2026-08-13T15:59:01.650Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ccc733a91b292cbe0428722b0d7a35df","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:01.657Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-363021d0373f367817064d1f: done: 0.015966 sec","job_status":"done","queue_duration_s":0.852944,"scheduling_latency_s":0.852966,"redis_calls":7,"redis_duration_s":0.001494,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00116,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000334,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010207,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015966,"completed_at":"2026-08-13T15:59:02.525Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1413gitlab # [ 294.827466] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:02.527Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"e10acb43d3c0fbd94b4ba211","created_at":"2026-08-13T15:59:01.686Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f1797528fe2acbf59b3fb848b639e393","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:01.693Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-e10acb43d3c0fbd94b4ba211: start","job_status":"start","queue_duration_s":0.834178,"scheduling_latency_s":0.834196}1414gitlab # [ 294.841885] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:02.560Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"e10acb43d3c0fbd94b4ba211","created_at":"2026-08-13T15:59:01.686Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f1797528fe2acbf59b3fb848b639e393","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:01.693Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-e10acb43d3c0fbd94b4ba211: done: 0.033251 sec","job_status":"done","queue_duration_s":0.834178,"scheduling_latency_s":0.834196,"redis_calls":7,"redis_duration_s":0.0012360000000000001,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000905,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000331,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014447,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033251,"completed_at":"2026-08-13T15:59:02.560Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013798,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1415gitlab # [ 294.884209] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:02.563Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"5925f77153300026b7e9e820","created_at":"2026-08-13T15:59:01.713Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"192044aec44a6ff1390bb1327132a773","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:01.718Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-5925f77153300026b7e9e820: start","job_status":"start","queue_duration_s":0.844544,"scheduling_latency_s":0.844568}1416gitlab # [ 294.898922] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:02.580Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"5925f77153300026b7e9e820","created_at":"2026-08-13T15:59:01.713Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"192044aec44a6ff1390bb1327132a773","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:01.718Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-5925f77153300026b7e9e820: done: 0.017927 sec","job_status":"done","queue_duration_s":0.844544,"scheduling_latency_s":0.844568,"redis_calls":7,"redis_duration_s":0.001557,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000938,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000619,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011573,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017927,"completed_at":"2026-08-13T15:59:02.580Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1417gitlab # [ 294.940700] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:02.582Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"5918b13fdc06e1b82c7a4700","created_at":"2026-08-13T15:59:01.740Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2eac555659cd0eb9857457b5b9b04efc","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:01.747Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-5918b13fdc06e1b82c7a4700: start","job_status":"start","queue_duration_s":0.835579,"scheduling_latency_s":0.835598}1418gitlab # [ 294.954671] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:02.615Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"5918b13fdc06e1b82c7a4700","created_at":"2026-08-13T15:59:01.740Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2eac555659cd0eb9857457b5b9b04efc","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:01.747Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-5918b13fdc06e1b82c7a4700: done: 0.032761 sec","job_status":"done","queue_duration_s":0.835579,"scheduling_latency_s":0.835598,"redis_calls":7,"redis_duration_s":0.001261,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000929,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000332,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012136,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.032761,"completed_at":"2026-08-13T15:59:02.615Z","load_balancing_strategy":"primary","db_duration_s":0.015385,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1419gitlab # [ 294.996532] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:02.616Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Gitlab::JiraImport::StuckJiraImportJobsWorker","jid":"97bbec1bf272546acd81fdfe","created_at":"2026-08-13T15:59:01.762Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"56abe21f00d6012aa7291653d41ca24b","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b9cf6c9b6c2f8fad80e08693d59af787bb65ad6ffe24ec5d0e1a669517566127","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:01.777Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Gitlab::JiraImport::StuckJiraImportJobsWorker JID-97bbec1bf272546acd81fdfe: start","job_status":"start","queue_duration_s":0.83901,"scheduling_latency_s":0.83903}1420gitlab # [ 295.010085] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:02.639Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Gitlab::JiraImport::StuckJiraImportJobsWorker","jid":"97bbec1bf272546acd81fdfe","created_at":"2026-08-13T15:59:01.762Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"56abe21f00d6012aa7291653d41ca24b","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b9cf6c9b6c2f8fad80e08693d59af787bb65ad6ffe24ec5d0e1a669517566127","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:01.777Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Gitlab::JiraImport::StuckJiraImportJobsWorker JID-97bbec1bf272546acd81fdfe: done: 0.022644 sec","job_status":"done","queue_duration_s":0.83901,"scheduling_latency_s":0.83903,"redis_calls":7,"redis_duration_s":0.001328,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000949,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000379,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014501,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022644,"completed_at":"2026-08-13T15:59:02.639Z","load_balancing_strategy":"primary","db_duration_s":0.002897,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1421gitlab # [ 295.049941] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:02.640Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"81696f3b2456ae6b929d82eb","created_at":"2026-08-13T15:59:01.790Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9c8df457a6a6b844238b5772704ac527","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:01.795Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-81696f3b2456ae6b929d82eb: start","job_status":"start","queue_duration_s":0.84512,"scheduling_latency_s":0.845139}1422gitlab # [ 295.065910] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:02.698Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"81696f3b2456ae6b929d82eb","created_at":"2026-08-13T15:59:01.790Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9c8df457a6a6b844238b5772704ac527","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:01.795Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-81696f3b2456ae6b929d82eb: done: 0.057121 sec","job_status":"done","queue_duration_s":0.84512,"scheduling_latency_s":0.845139,"redis_calls":9,"redis_duration_s":0.002026,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001052,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000974,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025874,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000736,"exclusive_lock_hold_duration_s":0.02759216,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.057121,"completed_at":"2026-08-13T15:59:02.697Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.026073,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1423gitlab # [ 295.109812] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:02.700Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"259b1089a8cb6f3b1c1a02fb","created_at":"2026-08-13T15:59:01.805Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0c152bf9d97f0041be33f13ad5e13aa1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:01.810Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-259b1089a8cb6f3b1c1a02fb: start","job_status":"start","queue_duration_s":0.889595,"scheduling_latency_s":0.889619}1424gitlab # [ 295.124748] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:02.740Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"259b1089a8cb6f3b1c1a02fb","created_at":"2026-08-13T15:59:01.805Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0c152bf9d97f0041be33f13ad5e13aa1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:01.810Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-259b1089a8cb6f3b1c1a02fb: done: 0.04064 sec","job_status":"done","queue_duration_s":0.889595,"scheduling_latency_s":0.889619,"redis_calls":9,"redis_duration_s":0.001691,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000894,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000797,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026156,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00064138,"exclusive_lock_hold_duration_s":0.02214576,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.04064,"completed_at":"2026-08-13T15:59:02.740Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009567,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1425gitlab # [ 295.168864] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:02.742Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"41f046d845654d76c1b14d02","created_at":"2026-08-13T15:59:01.847Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:01.850Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-41f046d845654d76c1b14d02: start","job_status":"start","queue_duration_s":0.891397,"scheduling_latency_s":0.891598}1426gitlab # [ 295.210316] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:02.835Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"41f046d845654d76c1b14d02","created_at":"2026-08-13T15:59:01.847Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:01.850Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-41f046d845654d76c1b14d02: done: 0.093901 sec","job_status":"done","queue_duration_s":0.891397,"scheduling_latency_s":0.891598,"redis_calls":60,"redis_duration_s":0.008753,"redis_read_bytes":108,"redis_write_bytes":41059,"redis_queues_calls":2,"redis_queues_duration_s":0.000613,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.007733,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000407,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.085544,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.093901,"completed_at":"2026-08-13T15:59:02.835Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1427gitlab # [ 295.282327] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:02.837Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"8a93dca89a3378934c9d9e71","created_at":"2026-08-13T15:59:01.868Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a29422a0804c6a9c88bf64739f80a900","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:01.873Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-8a93dca89a3378934c9d9e71: start","job_status":"start","queue_duration_s":0.963582,"scheduling_latency_s":0.963599}1428gitlab # [ 295.301853] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:02.844Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1429gitlab # [ 295.312694] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:02.851Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"8a93dca89a3378934c9d9e71","created_at":"2026-08-13T15:59:01.868Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a29422a0804c6a9c88bf64739f80a900","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:01.873Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-8a93dca89a3378934c9d9e71: done: 0.014587 sec","job_status":"done","queue_duration_s":0.963582,"scheduling_latency_s":0.963599,"redis_calls":7,"redis_duration_s":0.001018,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00075,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000268,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008573,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014587,"completed_at":"2026-08-13T15:59:02.851Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1430gitlab # [ 295.395892] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:02.852Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"5e184b7230289e0c0c377bbc","created_at":"2026-08-13T15:59:01.877Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"25dc1e69fb73f3ae72c699784e86296e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:01.882Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-5e184b7230289e0c0c377bbc: start","job_status":"start","queue_duration_s":0.970656,"scheduling_latency_s":0.970673}1431gitlab # [ 295.413899] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:02.860Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1432gitlab # [ 295.417970] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:02.865Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"5e184b7230289e0c0c377bbc","created_at":"2026-08-13T15:59:01.877Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"25dc1e69fb73f3ae72c699784e86296e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:01.882Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-5e184b7230289e0c0c377bbc: done: 0.012931 sec","job_status":"done","queue_duration_s":0.970656,"scheduling_latency_s":0.970673,"redis_calls":7,"redis_duration_s":0.000993,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000698,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000295,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008462,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012931,"completed_at":"2026-08-13T15:59:02.865Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1433gitlab # [ 295.460413] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:02.866Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"9539354a810519977202e33e","created_at":"2026-08-13T15:59:01.901Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dd2ef541b692344dfb8521a3296fd0f2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:01.905Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-9539354a810519977202e33e: start","job_status":"start","queue_duration_s":0.961525,"scheduling_latency_s":0.961541}1434gitlab # [ 295.502864] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:02.885Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"9539354a810519977202e33e","created_at":"2026-08-13T15:59:01.901Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dd2ef541b692344dfb8521a3296fd0f2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:01.905Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-9539354a810519977202e33e: done: 0.01829 sec","job_status":"done","queue_duration_s":0.961525,"scheduling_latency_s":0.961541,"redis_calls":9,"redis_duration_s":0.001559,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000761,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000798,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011242,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00045014,"exclusive_lock_hold_duration_s":0.00421198,"duration_s":0.01829,"completed_at":"2026-08-13T15:59:02.885Z","load_balancing_strategy":"primary","db_duration_s":0.001812,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1435gitlab # [ 295.581762] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:02.886Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"b65697d4dd30af8c1021d0ea","created_at":"2026-08-13T15:59:01.955Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eb8de5aa751daa52dd6654a41a55c8a5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:01.958Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-b65697d4dd30af8c1021d0ea: start","job_status":"start","queue_duration_s":0.927506,"scheduling_latency_s":0.927521}1436gitlab # [ 295.597893] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:02.913Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"b65697d4dd30af8c1021d0ea","created_at":"2026-08-13T15:59:01.955Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eb8de5aa751daa52dd6654a41a55c8a5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:01.958Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-b65697d4dd30af8c1021d0ea: done: 0.027328 sec","job_status":"done","queue_duration_s":0.927506,"scheduling_latency_s":0.927521,"redis_calls":14,"redis_duration_s":0.002038,"redis_read_bytes":16,"redis_write_bytes":4026,"redis_queues_calls":2,"redis_queues_duration_s":0.000202,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001412,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000424,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020113,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027328,"completed_at":"2026-08-13T15:59:02.913Z","load_balancing_strategy":"primary","db_duration_s":0.001774,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1437gitlab # [ 295.639940] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:02.914Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"5c607a37c7e83ce0c8d92348","created_at":"2026-08-13T15:59:01.977Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b364368f6ce1362576d4255bcd2629d8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-13T15:59:01.990Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-5c607a37c7e83ce0c8d92348: start","job_status":"start","queue_duration_s":0.924453,"scheduling_latency_s":0.92447}1438gitlab # [ 295.653783] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:02.922Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1439gitlab # [ 295.657614] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:02.927Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"5c607a37c7e83ce0c8d92348","created_at":"2026-08-13T15:59:01.977Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b364368f6ce1362576d4255bcd2629d8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-13T15:59:01.990Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-5c607a37c7e83ce0c8d92348: done: 0.012649 sec","job_status":"done","queue_duration_s":0.924453,"scheduling_latency_s":0.92447,"redis_calls":7,"redis_duration_s":0.000954,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000682,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000272,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008404,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012649,"completed_at":"2026-08-13T15:59:02.927Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1440gitlab # [ 295.696992] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:02.928Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"eba4a0d04c0762ca611f6050","created_at":"2026-08-13T15:59:02.028Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"99fd1dde7c969505f1178319e1b2a476","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.035Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-eba4a0d04c0762ca611f6050: start","job_status":"start","queue_duration_s":0.89308,"scheduling_latency_s":0.893096}1441gitlab # [ 295.711347] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.279Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"eba4a0d04c0762ca611f6050","created_at":"2026-08-13T15:59:02.028Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-432adc9212104672","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"99fd1dde7c969505f1178319e1b2a476","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.035Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-eba4a0d04c0762ca611f6050: done: 0.350586 sec","job_status":"done","queue_duration_s":0.89308,"scheduling_latency_s":0.893096,"redis_calls":562,"redis_duration_s":0.05771,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000764,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.056946,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.310815,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.350586,"completed_at":"2026-08-13T15:59:03.279Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1442gitlab # [ 295.754151] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.280Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5fb47bc27d2d83221706b554","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5fb47bc27d2d83221706b554: start","job_status":"start","queue_duration_s":0.451839,"scheduling_latency_s":0.451861}1443gitlab # [ 295.766785] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.295Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5fb47bc27d2d83221706b554","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5fb47bc27d2d83221706b554: done: 0.015448 sec","job_status":"done","queue_duration_s":0.451839,"scheduling_latency_s":0.451861,"redis_calls":13,"redis_duration_s":0.001514,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000536,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000978,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010405,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015448,"completed_at":"2026-08-13T15:59:03.295Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1444gitlab # [ 295.806997] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.297Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c701e119256ca8a2e0bd131d","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c701e119256ca8a2e0bd131d: start","job_status":"start","queue_duration_s":0.468424,"scheduling_latency_s":0.468441}1445gitlab # [ 295.819878] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.311Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c701e119256ca8a2e0bd131d","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c701e119256ca8a2e0bd131d: done: 0.014674 sec","job_status":"done","queue_duration_s":0.468424,"scheduling_latency_s":0.468441,"redis_calls":13,"redis_duration_s":0.001518,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000979,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010048,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014674,"completed_at":"2026-08-13T15:59:03.311Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1446gitlab # [ 295.859849] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.313Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc5ff15d47428a276043fd09","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc5ff15d47428a276043fd09: start","job_status":"start","queue_duration_s":0.484278,"scheduling_latency_s":0.484295}1447gitlab # [ 295.872492] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.327Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc5ff15d47428a276043fd09","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc5ff15d47428a276043fd09: done: 0.014716 sec","job_status":"done","queue_duration_s":0.484278,"scheduling_latency_s":0.484295,"redis_calls":13,"redis_duration_s":0.0015249999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000974,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010152,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014716,"completed_at":"2026-08-13T15:59:03.327Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1448gitlab # [ 295.913384] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.329Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b1750f890cf9e8d4290d78a","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b1750f890cf9e8d4290d78a: start","job_status":"start","queue_duration_s":0.500291,"scheduling_latency_s":0.500308}1449gitlab # [ 295.926014] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.343Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b1750f890cf9e8d4290d78a","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b1750f890cf9e8d4290d78a: done: 0.01459 sec","job_status":"done","queue_duration_s":0.500291,"scheduling_latency_s":0.500308,"redis_calls":13,"redis_duration_s":0.001522,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00058,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000942,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010012,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01459,"completed_at":"2026-08-13T15:59:03.343Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1450gitlab # [ 295.965214] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.344Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"68720add8f88d6f18031807b","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-68720add8f88d6f18031807b: start","job_status":"start","queue_duration_s":0.515968,"scheduling_latency_s":0.515985}1451gitlab # [ 295.977508] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.358Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"68720add8f88d6f18031807b","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-68720add8f88d6f18031807b: done: 0.014186 sec","job_status":"done","queue_duration_s":0.515968,"scheduling_latency_s":0.515985,"redis_calls":13,"redis_duration_s":0.001445,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000922,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00979,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014186,"completed_at":"2026-08-13T15:59:03.358Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1452gitlab # [ 296.017160] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.360Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"19d11fa22628063054a316cc","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-19d11fa22628063054a316cc: start","job_status":"start","queue_duration_s":0.531265,"scheduling_latency_s":0.531281}1453gitlab # [ 296.029280] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.374Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"19d11fa22628063054a316cc","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-19d11fa22628063054a316cc: done: 0.014159 sec","job_status":"done","queue_duration_s":0.531265,"scheduling_latency_s":0.531281,"redis_calls":13,"redis_duration_s":0.0014529999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000918,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00984,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014159,"completed_at":"2026-08-13T15:59:03.374Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1454gitlab # [ 296.068750] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.376Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5a44fe3bf66d5c937812f34f","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5a44fe3bf66d5c937812f34f: start","job_status":"start","queue_duration_s":0.547622,"scheduling_latency_s":0.54764}1455gitlab # [ 296.081185] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.392Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5a44fe3bf66d5c937812f34f","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5a44fe3bf66d5c937812f34f: done: 0.016018 sec","job_status":"done","queue_duration_s":0.547622,"scheduling_latency_s":0.54764,"redis_calls":13,"redis_duration_s":0.0017109999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00069,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001021,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011125,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016018,"completed_at":"2026-08-13T15:59:03.392Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1456gitlab # [ 296.121442] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.393Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"74a3a699b52b33c652d2b727","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-74a3a699b52b33c652d2b727: start","job_status":"start","queue_duration_s":0.56474,"scheduling_latency_s":0.564757}1457gitlab # [ 296.133945] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.408Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"74a3a699b52b33c652d2b727","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-74a3a699b52b33c652d2b727: done: 0.015096 sec","job_status":"done","queue_duration_s":0.56474,"scheduling_latency_s":0.564757,"redis_calls":13,"redis_duration_s":0.0017439999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000558,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001186,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010348,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015096,"completed_at":"2026-08-13T15:59:03.408Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1458gitlab # [ 296.173138] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.409Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa1cf2c92738b54a813e2d88","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa1cf2c92738b54a813e2d88: start","job_status":"start","queue_duration_s":0.580927,"scheduling_latency_s":0.580944}1459gitlab # [ 296.185605] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.423Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa1cf2c92738b54a813e2d88","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa1cf2c92738b54a813e2d88: done: 0.014115 sec","job_status":"done","queue_duration_s":0.580927,"scheduling_latency_s":0.580944,"redis_calls":13,"redis_duration_s":0.001473,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000947,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009791,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014115,"completed_at":"2026-08-13T15:59:03.423Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1460gitlab # [ 296.224879] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.424Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dde46490d7ca5ae0a43a0da3","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dde46490d7ca5ae0a43a0da3: start","job_status":"start","queue_duration_s":0.596129,"scheduling_latency_s":0.596145}1461gitlab # [ 296.237286] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.439Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dde46490d7ca5ae0a43a0da3","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dde46490d7ca5ae0a43a0da3: done: 0.014803 sec","job_status":"done","queue_duration_s":0.596129,"scheduling_latency_s":0.596145,"redis_calls":13,"redis_duration_s":0.001474,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000949,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009831,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014803,"completed_at":"2026-08-13T15:59:03.439Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1462gitlab # [ 296.276515] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.440Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e69a55b15caa9aeae46df14","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e69a55b15caa9aeae46df14: start","job_status":"start","queue_duration_s":0.612028,"scheduling_latency_s":0.612044}1463gitlab # [ 296.288870] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.455Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e69a55b15caa9aeae46df14","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e69a55b15caa9aeae46df14: done: 0.014314 sec","job_status":"done","queue_duration_s":0.612028,"scheduling_latency_s":0.612044,"redis_calls":13,"redis_duration_s":0.001473,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000533,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00094,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009897,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014314,"completed_at":"2026-08-13T15:59:03.455Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1464gitlab # [ 296.329655] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.456Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"58d40c7b3bb12311e0e3e88a","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-58d40c7b3bb12311e0e3e88a: start","job_status":"start","queue_duration_s":0.627439,"scheduling_latency_s":0.627455}1465gitlab # [ 296.342431] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.470Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"58d40c7b3bb12311e0e3e88a","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-58d40c7b3bb12311e0e3e88a: done: 0.014076 sec","job_status":"done","queue_duration_s":0.627439,"scheduling_latency_s":0.627455,"redis_calls":13,"redis_duration_s":0.001447,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000909,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009735,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014076,"completed_at":"2026-08-13T15:59:03.470Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1466gitlab # [ 296.382457] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.471Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d1c93f5a5797f8222c066485","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d1c93f5a5797f8222c066485: start","job_status":"start","queue_duration_s":0.642628,"scheduling_latency_s":0.642644}1467gitlab # [ 296.395248] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.485Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d1c93f5a5797f8222c066485","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d1c93f5a5797f8222c066485: done: 0.014431 sec","job_status":"done","queue_duration_s":0.642628,"scheduling_latency_s":0.642644,"redis_calls":13,"redis_duration_s":0.001461,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000932,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009968,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014431,"completed_at":"2026-08-13T15:59:03.485Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1468gitlab # [ 296.435607] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.486Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c0cc1bf5c6f247d0d609b8f5","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c0cc1bf5c6f247d0d609b8f5: start","job_status":"start","queue_duration_s":0.65822,"scheduling_latency_s":0.658236}1469gitlab # [ 296.448325] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.501Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c0cc1bf5c6f247d0d609b8f5","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c0cc1bf5c6f247d0d609b8f5: done: 0.014111 sec","job_status":"done","queue_duration_s":0.65822,"scheduling_latency_s":0.658236,"redis_calls":13,"redis_duration_s":0.001447,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000519,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000928,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009829,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014111,"completed_at":"2026-08-13T15:59:03.501Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1470gitlab # [ 296.488961] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.502Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f4b97b1d1bacf305cab6444","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f4b97b1d1bacf305cab6444: start","job_status":"start","queue_duration_s":0.673442,"scheduling_latency_s":0.673459}1471gitlab # [ 296.501568] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.516Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f4b97b1d1bacf305cab6444","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f4b97b1d1bacf305cab6444: done: 0.014218 sec","job_status":"done","queue_duration_s":0.673442,"scheduling_latency_s":0.673459,"redis_calls":13,"redis_duration_s":0.001557,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001018,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009912,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014218,"completed_at":"2026-08-13T15:59:03.516Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1472gitlab # [ 296.542260] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.517Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e5c1771a7ca6d3267e95be5f","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e5c1771a7ca6d3267e95be5f: start","job_status":"start","queue_duration_s":0.688768,"scheduling_latency_s":0.688784}1473gitlab # [ 296.555054] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.531Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e5c1771a7ca6d3267e95be5f","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e5c1771a7ca6d3267e95be5f: done: 0.014113 sec","job_status":"done","queue_duration_s":0.688768,"scheduling_latency_s":0.688784,"redis_calls":13,"redis_duration_s":0.001447,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000922,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009774,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014113,"completed_at":"2026-08-13T15:59:03.531Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1474gitlab # [ 296.595210] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.532Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e089aa312e9ee08a8b9fadd5","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e089aa312e9ee08a8b9fadd5: start","job_status":"start","queue_duration_s":0.703965,"scheduling_latency_s":0.703981}1475gitlab # [ 296.608233] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.547Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e089aa312e9ee08a8b9fadd5","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e089aa312e9ee08a8b9fadd5: done: 0.014347 sec","job_status":"done","queue_duration_s":0.703965,"scheduling_latency_s":0.703981,"redis_calls":13,"redis_duration_s":0.0014260000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000519,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000907,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009756,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014347,"completed_at":"2026-08-13T15:59:03.546Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1476gitlab # [ 296.648380] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.548Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63bf4eb3cdbdc29b3813ceda","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63bf4eb3cdbdc29b3813ceda: start","job_status":"start","queue_duration_s":0.719524,"scheduling_latency_s":0.71954}1477gitlab # [ 296.660820] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.563Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63bf4eb3cdbdc29b3813ceda","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63bf4eb3cdbdc29b3813ceda: done: 0.014776 sec","job_status":"done","queue_duration_s":0.719524,"scheduling_latency_s":0.71954,"redis_calls":13,"redis_duration_s":0.0015040000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000955,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010034,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014776,"completed_at":"2026-08-13T15:59:03.562Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1478gitlab # [ 296.701306] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.564Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7470a69fa5d3ca0d81d2048d","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7470a69fa5d3ca0d81d2048d: start","job_status":"start","queue_duration_s":0.735428,"scheduling_latency_s":0.735445}1479gitlab # [ 296.714022] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.579Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7470a69fa5d3ca0d81d2048d","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7470a69fa5d3ca0d81d2048d: done: 0.015765 sec","job_status":"done","queue_duration_s":0.735428,"scheduling_latency_s":0.735445,"redis_calls":13,"redis_duration_s":0.0018280000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000829,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000999,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010965,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015765,"completed_at":"2026-08-13T15:59:03.579Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1480gitlab # [ 296.754849] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.581Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3f7088d4a0986a1408bb7554","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3f7088d4a0986a1408bb7554: start","job_status":"start","queue_duration_s":0.75229,"scheduling_latency_s":0.752307}1481gitlab # [ 296.767623] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.595Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3f7088d4a0986a1408bb7554","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3f7088d4a0986a1408bb7554: done: 0.014279 sec","job_status":"done","queue_duration_s":0.75229,"scheduling_latency_s":0.752307,"redis_calls":13,"redis_duration_s":0.001452,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000914,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009839,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014279,"completed_at":"2026-08-13T15:59:03.595Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1482gitlab # [ 296.807781] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.596Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8cbfd47f2d124cb0c1a77a59","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8cbfd47f2d124cb0c1a77a59: start","job_status":"start","queue_duration_s":0.767702,"scheduling_latency_s":0.767718}1483gitlab # [ 296.820605] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.610Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8cbfd47f2d124cb0c1a77a59","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8cbfd47f2d124cb0c1a77a59: done: 0.014272 sec","job_status":"done","queue_duration_s":0.767702,"scheduling_latency_s":0.767718,"redis_calls":13,"redis_duration_s":0.00146,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000936,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009865,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014272,"completed_at":"2026-08-13T15:59:03.610Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1484gitlab # [ 296.859635] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.611Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8007d7849230693e42a4c7b7","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8007d7849230693e42a4c7b7: start","job_status":"start","queue_duration_s":0.783122,"scheduling_latency_s":0.783139}1485gitlab # [ 296.872149] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.626Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8007d7849230693e42a4c7b7","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8007d7849230693e42a4c7b7: done: 0.014494 sec","job_status":"done","queue_duration_s":0.783122,"scheduling_latency_s":0.783139,"redis_calls":13,"redis_duration_s":0.00151,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000567,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000943,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010018,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014494,"completed_at":"2026-08-13T15:59:03.626Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1486gitlab # [ 296.912088] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.627Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f6638e7fb5b81508be134f86","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f6638e7fb5b81508be134f86: start","job_status":"start","queue_duration_s":0.798884,"scheduling_latency_s":0.798905}1487gitlab # [ 296.924614] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.641Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f6638e7fb5b81508be134f86","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f6638e7fb5b81508be134f86: done: 0.014347 sec","job_status":"done","queue_duration_s":0.798884,"scheduling_latency_s":0.798905,"redis_calls":13,"redis_duration_s":0.0014390000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009846,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014347,"completed_at":"2026-08-13T15:59:03.641Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1488gitlab # [ 296.965546] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.643Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5987caac9beb6f0889e2a5a","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5987caac9beb6f0889e2a5a: start","job_status":"start","queue_duration_s":0.814337,"scheduling_latency_s":0.814353}1489gitlab # [ 297.003518] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.657Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5987caac9beb6f0889e2a5a","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5987caac9beb6f0889e2a5a: done: 0.014247 sec","job_status":"done","queue_duration_s":0.814337,"scheduling_latency_s":0.814353,"redis_calls":13,"redis_duration_s":0.001446,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000918,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00992,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014247,"completed_at":"2026-08-13T15:59:03.657Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1490gitlab # [ 297.075282] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.658Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"606a485374a0080e620f6734","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-606a485374a0080e620f6734: start","job_status":"start","queue_duration_s":0.829678,"scheduling_latency_s":0.829694}1491gitlab # [ 297.111742] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.672Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"606a485374a0080e620f6734","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-606a485374a0080e620f6734: done: 0.014362 sec","job_status":"done","queue_duration_s":0.829678,"scheduling_latency_s":0.829694,"redis_calls":13,"redis_duration_s":0.0015110000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000564,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000947,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010011,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014362,"completed_at":"2026-08-13T15:59:03.672Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1492gitlab # [ 297.187422] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.673Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51ea4ad20aaa4b84269dc8b2","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51ea4ad20aaa4b84269dc8b2: start","job_status":"start","queue_duration_s":0.845176,"scheduling_latency_s":0.845193}1493gitlab # [ 297.225089] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.688Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51ea4ad20aaa4b84269dc8b2","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51ea4ad20aaa4b84269dc8b2: done: 0.01475 sec","job_status":"done","queue_duration_s":0.845176,"scheduling_latency_s":0.845193,"redis_calls":13,"redis_duration_s":0.0014759999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000949,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010072,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01475,"completed_at":"2026-08-13T15:59:03.688Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1494gitlab # [ 297.295335] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.689Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c2efc3e26d0bf557db70892a","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c2efc3e26d0bf557db70892a: start","job_status":"start","queue_duration_s":0.861036,"scheduling_latency_s":0.861053}1495gitlab # [ 297.309693] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.703Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c2efc3e26d0bf557db70892a","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c2efc3e26d0bf557db70892a: done: 0.014203 sec","job_status":"done","queue_duration_s":0.861036,"scheduling_latency_s":0.861053,"redis_calls":13,"redis_duration_s":0.001437,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009866,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014203,"completed_at":"2026-08-13T15:59:03.703Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1496gitlab # [ 297.350323] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.705Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0186ee82d32967385bf786d7","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0186ee82d32967385bf786d7: start","job_status":"start","queue_duration_s":0.876317,"scheduling_latency_s":0.876334}1497gitlab # [ 297.364078] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.719Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0186ee82d32967385bf786d7","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0186ee82d32967385bf786d7: done: 0.014935 sec","job_status":"done","queue_duration_s":0.876317,"scheduling_latency_s":0.876334,"redis_calls":14,"redis_duration_s":0.001582,"redis_read_bytes":44,"redis_write_bytes":1192,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000121,"redis_feature_flag_read_bytes":34,"redis_feature_flag_write_bytes":35,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000929,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010539,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014935,"completed_at":"2026-08-13T15:59:03.719Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1498gitlab # [ 297.405153] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.721Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a0d3d9bbe8983de9017c2fd","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a0d3d9bbe8983de9017c2fd: start","job_status":"start","queue_duration_s":0.892361,"scheduling_latency_s":0.892378}1499gitlab # [ 297.417496] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.735Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a0d3d9bbe8983de9017c2fd","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a0d3d9bbe8983de9017c2fd: done: 0.014125 sec","job_status":"done","queue_duration_s":0.892361,"scheduling_latency_s":0.892378,"redis_calls":13,"redis_duration_s":0.0014290000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000901,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009758,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014125,"completed_at":"2026-08-13T15:59:03.735Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1500gitlab # [ 297.456639] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.736Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c59037d48b771787db22171","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c59037d48b771787db22171: start","job_status":"start","queue_duration_s":0.907604,"scheduling_latency_s":0.907621}1501gitlab # [ 297.469167] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.750Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c59037d48b771787db22171","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c59037d48b771787db22171: done: 0.014348 sec","job_status":"done","queue_duration_s":0.907604,"scheduling_latency_s":0.907621,"redis_calls":13,"redis_duration_s":0.001495,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000955,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009924,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014348,"completed_at":"2026-08-13T15:59:03.750Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1502gitlab # [ 297.508738] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.751Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c315aa614bc35ba4cd34bcf4","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c315aa614bc35ba4cd34bcf4: start","job_status":"start","queue_duration_s":0.923055,"scheduling_latency_s":0.923071}1503gitlab # [ 297.521156] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.765Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c315aa614bc35ba4cd34bcf4","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c315aa614bc35ba4cd34bcf4: done: 0.014131 sec","job_status":"done","queue_duration_s":0.923055,"scheduling_latency_s":0.923071,"redis_calls":13,"redis_duration_s":0.001435,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000915,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009827,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014131,"completed_at":"2026-08-13T15:59:03.765Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1504gitlab # [ 297.561374] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.767Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b6aa2fb09b9e1eb584c6cc9b","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b6aa2fb09b9e1eb584c6cc9b: start","job_status":"start","queue_duration_s":0.938287,"scheduling_latency_s":0.938304}1505gitlab # [ 297.573939] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.781Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b6aa2fb09b9e1eb584c6cc9b","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b6aa2fb09b9e1eb584c6cc9b: done: 0.014454 sec","job_status":"done","queue_duration_s":0.938287,"scheduling_latency_s":0.938304,"redis_calls":13,"redis_duration_s":0.001677,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000559,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001118,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010012,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014454,"completed_at":"2026-08-13T15:59:03.781Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1506gitlab # [ 297.613391] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.782Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"227dd9196e4ad0d3c30706ca","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-227dd9196e4ad0d3c30706ca: start","job_status":"start","queue_duration_s":0.953884,"scheduling_latency_s":0.953901}1507gitlab # [ 297.625693] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.797Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"227dd9196e4ad0d3c30706ca","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-227dd9196e4ad0d3c30706ca: done: 0.014596 sec","job_status":"done","queue_duration_s":0.953884,"scheduling_latency_s":0.953901,"redis_calls":13,"redis_duration_s":0.001487,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000963,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010018,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014596,"completed_at":"2026-08-13T15:59:03.797Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1508gitlab # [ 297.664924] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.798Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8a7dff39b8d8fb11b6019ce","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8a7dff39b8d8fb11b6019ce: start","job_status":"start","queue_duration_s":0.969599,"scheduling_latency_s":0.969615}1509gitlab # [ 297.677402] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.812Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8a7dff39b8d8fb11b6019ce","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8a7dff39b8d8fb11b6019ce: done: 0.014421 sec","job_status":"done","queue_duration_s":0.969599,"scheduling_latency_s":0.969615,"redis_calls":13,"redis_duration_s":0.0015179999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000975,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010019,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014421,"completed_at":"2026-08-13T15:59:03.812Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1510gitlab # [ 297.716481] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.813Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"54bcd914677b1ac40b3f16b0","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-54bcd914677b1ac40b3f16b0: start","job_status":"start","queue_duration_s":0.985182,"scheduling_latency_s":0.9852}1511gitlab # [ 297.728745] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.828Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"54bcd914677b1ac40b3f16b0","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-54bcd914677b1ac40b3f16b0: done: 0.01421 sec","job_status":"done","queue_duration_s":0.985182,"scheduling_latency_s":0.9852,"redis_calls":13,"redis_duration_s":0.001529,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000573,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000956,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009868,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01421,"completed_at":"2026-08-13T15:59:03.828Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1512gitlab # [ 297.768571] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.829Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b34b5b5c1e3f6df14cb34b0","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b34b5b5c1e3f6df14cb34b0: start","job_status":"start","queue_duration_s":1.000462,"scheduling_latency_s":1.000478}1513gitlab # [ 297.781105] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.843Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b34b5b5c1e3f6df14cb34b0","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b34b5b5c1e3f6df14cb34b0: done: 0.014251 sec","job_status":"done","queue_duration_s":1.000462,"scheduling_latency_s":1.000478,"redis_calls":13,"redis_duration_s":0.001472,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000945,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009798,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014251,"completed_at":"2026-08-13T15:59:03.843Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1514gitlab # [ 297.820549] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.844Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6bac84fc43881bae59323457","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6bac84fc43881bae59323457: start","job_status":"start","queue_duration_s":1.015883,"scheduling_latency_s":1.0159}1515gitlab # [ 297.832665] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.858Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6bac84fc43881bae59323457","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6bac84fc43881bae59323457: done: 0.014345 sec","job_status":"done","queue_duration_s":1.015883,"scheduling_latency_s":1.0159,"redis_calls":13,"redis_duration_s":0.001447,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000533,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000914,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009894,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014345,"completed_at":"2026-08-13T15:59:03.858Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1516gitlab # [ 297.871594] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.860Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c52a063e47b299dfb4e0ff11","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c52a063e47b299dfb4e0ff11: start","job_status":"start","queue_duration_s":1.031328,"scheduling_latency_s":1.031345}1517gitlab # [ 297.884063] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.875Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c52a063e47b299dfb4e0ff11","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c52a063e47b299dfb4e0ff11: done: 0.015823 sec","job_status":"done","queue_duration_s":1.031328,"scheduling_latency_s":1.031345,"redis_calls":13,"redis_duration_s":0.0015439999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001024,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010236,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015823,"completed_at":"2026-08-13T15:59:03.875Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1518gitlab # [ 297.922911] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.877Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0380f58df8f7d507775e6d99","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0380f58df8f7d507775e6d99: start","job_status":"start","queue_duration_s":1.048493,"scheduling_latency_s":1.04851}1519gitlab # [ 297.935399] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.891Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0380f58df8f7d507775e6d99","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0380f58df8f7d507775e6d99: done: 0.014355 sec","job_status":"done","queue_duration_s":1.048493,"scheduling_latency_s":1.04851,"redis_calls":13,"redis_duration_s":0.00145,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000921,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009862,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014355,"completed_at":"2026-08-13T15:59:03.891Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1520gitlab # [ 297.975917] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.892Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f789616fd5c0ec26a4d0ef73","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f789616fd5c0ec26a4d0ef73: start","job_status":"start","queue_duration_s":1.063975,"scheduling_latency_s":1.063993}1521gitlab # [ 297.988415] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.907Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f789616fd5c0ec26a4d0ef73","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f789616fd5c0ec26a4d0ef73: done: 0.015058 sec","job_status":"done","queue_duration_s":1.063975,"scheduling_latency_s":1.063993,"redis_calls":13,"redis_duration_s":0.001572,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000609,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000963,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010139,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015058,"completed_at":"2026-08-13T15:59:03.907Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1522gitlab # [ 298.028925] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.908Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"195de63e8786379694cca6cc","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-195de63e8786379694cca6cc: start","job_status":"start","queue_duration_s":1.080187,"scheduling_latency_s":1.080204}1523gitlab # [ 298.041767] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.923Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"195de63e8786379694cca6cc","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-195de63e8786379694cca6cc: done: 0.014211 sec","job_status":"done","queue_duration_s":1.080187,"scheduling_latency_s":1.080204,"redis_calls":13,"redis_duration_s":0.001433,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000906,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009785,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014211,"completed_at":"2026-08-13T15:59:03.923Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1524gitlab # [ 298.081980] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.924Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"580a8757b50c95ee2de3aedd","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-580a8757b50c95ee2de3aedd: start","job_status":"start","queue_duration_s":1.095486,"scheduling_latency_s":1.095502}1525gitlab # [ 298.094920] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.938Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"580a8757b50c95ee2de3aedd","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-580a8757b50c95ee2de3aedd: done: 0.014177 sec","job_status":"done","queue_duration_s":1.095486,"scheduling_latency_s":1.095502,"redis_calls":13,"redis_duration_s":0.001456,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000906,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009833,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014177,"completed_at":"2026-08-13T15:59:03.938Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1526gitlab # [ 298.135285] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.939Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf074dae3213be7e0c8ed229","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf074dae3213be7e0c8ed229: start","job_status":"start","queue_duration_s":1.110793,"scheduling_latency_s":1.11081}1527gitlab # [ 298.148349] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.953Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf074dae3213be7e0c8ed229","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf074dae3213be7e0c8ed229: done: 0.01409 sec","job_status":"done","queue_duration_s":1.110793,"scheduling_latency_s":1.11081,"redis_calls":13,"redis_duration_s":0.0014269999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000913,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009808,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01409,"completed_at":"2026-08-13T15:59:03.953Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1528gitlab # [ 298.189561] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.954Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"303d9d5d2fd2cdd2bfb0ec45","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-303d9d5d2fd2cdd2bfb0ec45: start","job_status":"start","queue_duration_s":1.12611,"scheduling_latency_s":1.126126}1529gitlab # [ 298.202423] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.969Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"303d9d5d2fd2cdd2bfb0ec45","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-303d9d5d2fd2cdd2bfb0ec45: done: 0.014261 sec","job_status":"done","queue_duration_s":1.12611,"scheduling_latency_s":1.126126,"redis_calls":13,"redis_duration_s":0.00151,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000978,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009939,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014261,"completed_at":"2026-08-13T15:59:03.969Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1530gitlab # [ 298.242621] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.970Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"07c0b1bb4de5c6572cd382ae","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-07c0b1bb4de5c6572cd382ae: start","job_status":"start","queue_duration_s":1.14148,"scheduling_latency_s":1.141496}1531gitlab # [ 298.255740] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.984Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"07c0b1bb4de5c6572cd382ae","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-07c0b1bb4de5c6572cd382ae: done: 0.014595 sec","job_status":"done","queue_duration_s":1.14148,"scheduling_latency_s":1.141496,"redis_calls":13,"redis_duration_s":0.00155,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001004,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010103,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014595,"completed_at":"2026-08-13T15:59:03.984Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1532gitlab # [ 298.295899] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:03.985Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"131d54346b0a6e6d903de0fd","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-131d54346b0a6e6d903de0fd: start","job_status":"start","queue_duration_s":1.157189,"scheduling_latency_s":1.157206}1533gitlab # [ 298.309027] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:04.000Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"131d54346b0a6e6d903de0fd","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-131d54346b0a6e6d903de0fd: done: 0.014396 sec","job_status":"done","queue_duration_s":1.157189,"scheduling_latency_s":1.157206,"redis_calls":13,"redis_duration_s":0.001591,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000556,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001035,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009998,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014396,"completed_at":"2026-08-13T15:59:04.000Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1534gitlab # [ 298.349170] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:04.001Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05d5f234e7df6e57594b7fcc","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05d5f234e7df6e57594b7fcc: start","job_status":"start","queue_duration_s":1.172681,"scheduling_latency_s":1.172698}1535gitlab # [ 298.361432] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:04.015Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05d5f234e7df6e57594b7fcc","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05d5f234e7df6e57594b7fcc: done: 0.014222 sec","job_status":"done","queue_duration_s":1.172681,"scheduling_latency_s":1.172698,"redis_calls":13,"redis_duration_s":0.0014529999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000922,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00981,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014222,"completed_at":"2026-08-13T15:59:04.015Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1536gitlab # [ 298.402492] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:04.016Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c26c87932cdc6409b5f445e0","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c26c87932cdc6409b5f445e0: start","job_status":"start","queue_duration_s":1.187983,"scheduling_latency_s":1.187999}1537gitlab # [ 298.415416] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:04.030Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c26c87932cdc6409b5f445e0","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c26c87932cdc6409b5f445e0: done: 0.014251 sec","job_status":"done","queue_duration_s":1.187983,"scheduling_latency_s":1.187999,"redis_calls":13,"redis_duration_s":0.001449,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00092,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009842,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014251,"completed_at":"2026-08-13T15:59:04.030Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1538gitlab # [ 298.455391] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:04.032Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98af4c175dc48b260e4ba5b7","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98af4c175dc48b260e4ba5b7: start","job_status":"start","queue_duration_s":1.20332,"scheduling_latency_s":1.203335}1539gitlab # [ 298.468304] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:04.046Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98af4c175dc48b260e4ba5b7","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98af4c175dc48b260e4ba5b7: done: 0.014203 sec","job_status":"done","queue_duration_s":1.20332,"scheduling_latency_s":1.203335,"redis_calls":13,"redis_duration_s":0.001467,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000545,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000922,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009878,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014203,"completed_at":"2026-08-13T15:59:04.046Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1540gitlab # [ 298.508301] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:04.047Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fed7d4177d233c5ee5a6a1bd","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fed7d4177d233c5ee5a6a1bd: start","job_status":"start","queue_duration_s":1.218684,"scheduling_latency_s":1.218701}1541gitlab # [ 298.521176] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:04.061Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fed7d4177d233c5ee5a6a1bd","created_at":"2026-08-13T15:59:02.751Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-c13ab10dc7d94ce3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e9d1a365a5c32a39e95eb81bbb12c738","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.828Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fed7d4177d233c5ee5a6a1bd: done: 0.01432 sec","job_status":"done","queue_duration_s":1.218684,"scheduling_latency_s":1.218701,"redis_calls":13,"redis_duration_s":0.001459,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000921,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009946,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01432,"completed_at":"2026-08-13T15:59:04.061Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1542gitlab # [ 298.560712] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:04.062Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7fffc9b5f0edb0dc1421c74b","created_at":"2026-08-13T15:59:02.897Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-a633ef979fae49e3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"eb8de5aa751daa52dd6654a41a55c8a5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.907Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7fffc9b5f0edb0dc1421c74b: start","job_status":"start","queue_duration_s":1.154902,"scheduling_latency_s":1.154918}1543gitlab # [ 298.574256] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:04.075Z","message":"No existing merge request to be cleaned up."}1544gitlab # [ 298.575982] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:04.085Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7fffc9b5f0edb0dc1421c74b","created_at":"2026-08-13T15:59:02.897Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-a633ef979fae49e3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"eb8de5aa751daa52dd6654a41a55c8a5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.907Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7fffc9b5f0edb0dc1421c74b: done: 0.022446 sec","job_status":"done","queue_duration_s":1.154902,"scheduling_latency_s":1.154918,"redis_calls":10,"redis_duration_s":0.001377,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000583,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000794,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01428,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022446,"completed_at":"2026-08-13T15:59:04.085Z","load_balancing_strategy":"primary","db_duration_s":0.005528,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1545gitlab # [ 298.615478] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:04.086Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"71b8ea1686405019900ac7de","created_at":"2026-08-13T15:59:02.897Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-a633ef979fae49e3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"eb8de5aa751daa52dd6654a41a55c8a5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.907Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-71b8ea1686405019900ac7de: start","job_status":"start","queue_duration_s":1.178461,"scheduling_latency_s":1.178492}1546gitlab # [ 298.628264] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:04.096Z","message":"No existing merge request to be cleaned up."}1547gitlab # [ 298.629956] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:04.104Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"71b8ea1686405019900ac7de","created_at":"2026-08-13T15:59:02.897Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-a633ef979fae49e3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"eb8de5aa751daa52dd6654a41a55c8a5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.907Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-71b8ea1686405019900ac7de: done: 0.018395 sec","job_status":"done","queue_duration_s":1.178461,"scheduling_latency_s":1.178492,"redis_calls":10,"redis_duration_s":0.001418,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000636,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000782,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013165,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018395,"completed_at":"2026-08-13T15:59:04.104Z","load_balancing_strategy":"primary","db_duration_s":0.001556,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1548gitlab # [ 298.669497] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:04.105Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"45e17989d0a82fe579792fcd","created_at":"2026-08-13T15:59:02.897Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-a633ef979fae49e3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"eb8de5aa751daa52dd6654a41a55c8a5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.907Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-45e17989d0a82fe579792fcd: start","job_status":"start","queue_duration_s":1.197975,"scheduling_latency_s":1.197993}1549gitlab # [ 298.682140] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:04.115Z","message":"No existing merge request to be cleaned up."}1550gitlab # [ 298.683815] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:04.123Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"45e17989d0a82fe579792fcd","created_at":"2026-08-13T15:59:02.897Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-a633ef979fae49e3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"eb8de5aa751daa52dd6654a41a55c8a5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.907Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-45e17989d0a82fe579792fcd: done: 0.017882 sec","job_status":"done","queue_duration_s":1.197975,"scheduling_latency_s":1.197993,"redis_calls":10,"redis_duration_s":0.0013310000000000002,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000577,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000754,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012803,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017882,"completed_at":"2026-08-13T15:59:04.123Z","load_balancing_strategy":"primary","db_duration_s":0.001275,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1551gitlab # [ 298.723158] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:04.124Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b25b2351c85ced23a381adf1","created_at":"2026-08-13T15:59:02.897Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-a633ef979fae49e3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"eb8de5aa751daa52dd6654a41a55c8a5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.907Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b25b2351c85ced23a381adf1: start","job_status":"start","queue_duration_s":1.216962,"scheduling_latency_s":1.216979}1552gitlab # [ 298.735854] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:04.134Z","message":"No existing merge request to be cleaned up."}1553gitlab # [ 298.737615] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:04.142Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b25b2351c85ced23a381adf1","created_at":"2026-08-13T15:59:02.897Z","trace_propagation_headers":{"sentry-trace":"a134134cb2064ea2979647f365cdc391-a633ef979fae49e3","baggage":"sentry-trace_id=a134134cb2064ea2979647f365cdc391,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"eb8de5aa751daa52dd6654a41a55c8a5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:02.907Z","job_size_bytes":2,"pid":2027,"sidekiq_tid":"mao3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b25b2351c85ced23a381adf1: done: 0.017737 sec","job_status":"done","queue_duration_s":1.216962,"scheduling_latency_s":1.216979,"redis_calls":10,"redis_duration_s":0.00133,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000579,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000751,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012773,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017737,"completed_at":"2026-08-13T15:59:04.142Z","load_balancing_strategy":"primary","db_duration_s":0.001305,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1554gitlab # [ 308.101561] redis[792]: 10 changes in 300 seconds. Saving...1555gitlab # [ 308.110927] redis[792]: Background saving started by pid 33041556gitlab # [ 308.116844] redis[3304]: BGSAVE done, 449 keys saved, 0 keys skipped, 116897 bytes written.1557gitlab # [ 308.123271] redis[3304]: DB saved on disk1558gitlab # [ 308.125668] redis[3304]: Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB1559gitlab # [ 308.202688] redis[792]: Background saving terminated with success1560gitlab # [ 309.787286] postgres[866]: [866] LOG: checkpoint starting: time1561gitlab # [ 311.035893] gitaly[895]: time="2026-08-13T15:59:18.947Z" level=info msg="burden monitor stats" pid=8951562gitlab # [ 314.633270] postgres[3309]: [3309] ERROR: relation "table_without_models" does not exist1563gitlab # [ 314.633584] postgres[3309]: [3309] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1564gitlab # [ 320.403571] runuser[2966]: pam_unix(runuser:session): session closed for user gitlab1565gitlab # [ 320.405616] setup-gitlab-start[2940]: + systemctl restart gitlab-sidekiq.service1566gitlab # [ 320.446696] systemd[1]: Stopping gitlab-sidekiq.service...1567gitlab # [ 320.448188] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:28.359Z","message":"Shutting down"}1568gitlab # [ 320.449843] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:28.360Z","message":"Scheduler exiting..."}1569gitlab # [ 320.451523] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:28.362Z","message":"Terminating quiet threads for default capsule"}1570gitlab # [ 320.453655] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:28.362Z","message":"Scheduler exiting..."}1571gitlab # [ 320.950836] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:28.864Z","message":"Pausing to allow jobs to finish..."}1572gitlab # [ 321.454696] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:29.366Z","message":"Bye!"}1573gitlab # [ 321.496281] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-13T15:59:29.409Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":2027,"worker_id":"sidekiq_0","memwd_rss_bytes":953167872,"retry":0}1574gitlab # [ 323.010444] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1575gitlab # [ 323.010869] systemd[1]: Stopped gitlab-sidekiq.service.1576gitlab # [ 323.011087] systemd[1]: gitlab-sidekiq.service: Consumed 1min 52.628s CPU time over 3min 20.310s wall clock time, 947.3M memory peak, 4.4M read from disk.1577gitlab # [ 323.024830] systemd[1]: Started gitlab-sidekiq.service.1578gitlab # [ 323.029542] setup-gitlab-start[2940]: + mkdir -p /var/lib/secrets1579gitlab # [ 323.034767] setup-gitlab-start[2940]: + echo nixbot-test-token-of-20-chars1580gitlab # [ 323.038614] setup-gitlab-start[2940]: + chmod 644 /var/lib/secrets/gitlab-token1581gitlab # [ 323.041813] setup-gitlab-start[2940]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1582gitlab # [ 324.719302] gitaly[895]: time="2026-08-13T15:59:32.631Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KZXXK7NAMBW2QJNDVTTWY4A1 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-13T15:59:42.007" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T15:59:32.630" pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1583gitlab # [ 324.750887] gitaly[895]: time="2026-08-13T15:59:32.633Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZXXK7NAMBW2QJNDVTTWY4A1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-13T15:59:42.007" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T15:59:32.630" grpc.time_ms=1.406 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1584gitlab # [ 324.933889] gitaly[895]: time="2026-08-13T15:59:32.847Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KZXXK7NAMBW2QJNDVTTWY4A1 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-13T15:59:42.226" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T15:59:32.847" pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1585gitlab # [ 324.951630] gitaly[895]: time="2026-08-13T15:59:32.847Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZXXK7NAMBW2QJNDVTTWY4A1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-13T15:59:42.226" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T15:59:32.847" grpc.time_ms=0.622 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1586gitlab # [ 325.012167] gitaly[895]: time="2026-08-13T15:59:32.925Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZXXK7NAMBW2QJNDVTTWY4A1 diskcache=9246f64a-3de0-4c2e-b3b1-c8a1bff129a5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-13T15:59:42.241" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T15:59:32.863" pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1587gitlab # [ 325.031907] gitaly[895]: time="2026-08-13T15:59:32.926Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=31 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1436 command.oublock=32 command.real_time_ms=38 command.spawn_token_fork_ms=5 command.system_time_ms=16 command.user_time_ms=15 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXK7NAMBW2QJNDVTTWY4A1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-13T15:59:42.241" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T15:59:32.863" grpc.time_ms=62.684 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1588gitlab # [ 325.053184] gitaly[895]: time="2026-08-13T15:59:32.951Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01KZXXK7NAMBW2QJNDVTTWY4A1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-13T15:59:42.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T15:59:32.949" pid=895 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1589gitlab # [ 325.066853] gitaly[895]: time="2026-08-13T15:59:32.951Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZXXK7NAMBW2QJNDVTTWY4A1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-13T15:59:42.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T15:59:32.949" grpc.time_ms=1.804 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1590gitlab # [ 325.080169] gitaly[895]: time="2026-08-13T15:59:32.976Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXK7NAMBW2QJNDVTTWY4A1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-13T15:59:42.019" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T15:59:32.960" grpc.time_ms=16.21 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1591gitlab # [ 325.168780] gitaly[895]: time="2026-08-13T15:59:33.082Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KZXXK7NAMBW2QJNDVTTWY4A1 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-13T15:59:43.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T15:59:33.081" pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1592gitlab # [ 325.200554] gitaly[895]: time="2026-08-13T15:59:33.082Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZXXK7NAMBW2QJNDVTTWY4A1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-13T15:59:43.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T15:59:33.081" grpc.time_ms=0.577 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1593gitlab # [ 325.231389] gitaly[895]: time="2026-08-13T15:59:33.125Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZXXK7NAMBW2QJNDVTTWY4A1 diskcache=f8230f8e-a89a-438d-adbd-9b9e5161a772 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-13T15:59:43.004" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T15:59:33.085" pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1594gitlab # [ 325.251897] gitaly[895]: time="2026-08-13T15:59:33.126Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=17 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1441 command.oublock=32 command.real_time_ms=19 command.spawn_token_fork_ms=3 command.system_time_ms=8 command.user_time_ms=9 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXK7NAMBW2QJNDVTTWY4A1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-13T15:59:43.004" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T15:59:33.085" grpc.time_ms=40.969 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1595gitlab # [ 325.272563] gitaly[895]: time="2026-08-13T15:59:33.137Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01KZXXK7NAMBW2QJNDVTTWY4A1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-13T15:59:43.054" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T15:59:33.135" pid=895 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1596gitlab # [ 325.286835] gitaly[895]: time="2026-08-13T15:59:33.137Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZXXK7NAMBW2QJNDVTTWY4A1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-13T15:59:43.054" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T15:59:33.135" grpc.time_ms=1.876 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1597gitlab # [ 325.302099] gitaly[895]: time="2026-08-13T15:59:33.153Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=4 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXK7NAMBW2QJNDVTTWY4A1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-13T15:59:43.061" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T15:59:33.142" grpc.time_ms=11.064 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1598gitlab # [ 325.319704] gitaly[895]: time="2026-08-13T15:59:33.195Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZXXK7NAMBW2QJNDVTTWY4A1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-13T15:59:43.114" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T15:59:33.195" grpc.time_ms=0.312 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1599gitlab # [ 325.336102] gitaly[895]: time="2026-08-13T15:59:33.206Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZXXK7NAMBW2QJNDVTTWY4A1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-13T15:59:43.124" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T15:59:33.205" grpc.time_ms=0.819 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1600gitlab # [ 325.910109] gitaly[895]: time="2026-08-13T15:59:33.822Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXK7NAMBW2QJNDVTTWY4A1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-13T15:59:43.183" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T15:59:33.805" grpc.time_ms=17.299 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1601gitlab # [ 326.337285] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:15:59:34 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 32621602gitlab # [ 326.343907] setup-gitlab-start[2940]: + mkdir -p /tmp/test-flake1603gitlab # [ 326.346773] setup-gitlab-start[2940]: + cd /tmp/test-flake1604gitlab # [ 326.349176] setup-gitlab-start[2940]: + git init -b master1605gitlab # [ 326.373124] setup-gitlab-start[3420]: Initialized empty Git repository in /tmp/test-flake/.git/1606gitlab # [ 326.376788] setup-gitlab-start[2940]: + git config user.name test1607gitlab # [ 326.380215] setup-gitlab-start[2940]: + git config user.email test@example.com1608gitlab # [ 326.386718] setup-gitlab-start[2940]: + cat1609gitlab # [ 326.392164] setup-gitlab-start[2940]: + git add flake.nix1610gitlab # [ 326.400088] setup-gitlab-start[2940]: + git commit -m 'initial commit'1611gitlab # [ 326.419843] setup-gitlab-start[3425]: [master (root-commit) c63bd0c] initial commit1612gitlab # [ 326.423154] setup-gitlab-start[3425]: 1 file changed, 10 insertions(+)1613gitlab # [ 326.425767] setup-gitlab-start[3425]: create mode 100644 flake.nix1614gitlab # [ 326.428265] setup-gitlab-start[2940]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1615gitlab # [ 326.432609] setup-gitlab-start[2940]: + git push -u origin master1616gitlab # [ 326.554597] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:15:59:34 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 791617gitlab # [ 326.778245] gitaly[895]: time="2026-08-13T15:59:34.691Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZXXKB25VB4Q63T9WBAWDBRG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T15:59:34.674" grpc.time_ms=17.185 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1618gitlab # [ 326.808403] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:15:59:34 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 2231619gitlab # [ 327.667964] gitaly[895]: time="2026-08-13T15:59:35.580Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKB9SRRBN4XTJGZQPXG1C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-13T15:59:45.002" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T15:59:35.563" grpc.time_ms=17.571 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1620gitlab # [ 327.770154] gitaly[895]: time="2026-08-13T15:59:35.683Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=302 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXXKB9SRRBN4XTJGZQPXG1C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-13T16:00:05.061" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-13T15:59:35.662" grpc.time_ms=20.871 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1621gitlab # [ 327.898561] gitaly[895]: time="2026-08-13T15:59:35.812Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01KZXXKB9SRRBN4XTJGZQPXG1C duration_ms=913ns method=POST pid=895 status=200 url="http://unix/api/v4/internal/allowed"1622gitlab # [ 327.946735] gitaly[895]: time="2026-08-13T15:59:35.860Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01KZXXKB9SRRBN4XTJGZQPXG1C duration_ms=47ns method=POST pid=895 status=200 url="http://unix/api/v4/internal/pre_receive"1623gitlab # [ 327.955917] gitaly[895]: time="2026-08-13T15:59:35.860Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXXKB9SRRBN4XTJGZQPXG1C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5315 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T15:59:34.896" grpc.time_ms=964.435 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1624gitlab # [ 328.036841] gitaly[895]: time="2026-08-13T15:59:35.950Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXXKB9SRRBN4XTJGZQPXG1C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T15:59:35.948" grpc.time_ms=1.432 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1625gitlab # [ 328.124610] gitaly[895]: time="2026-08-13T15:59:36.038Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXXKB9SRRBN4XTJGZQPXG1C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4784 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T15:59:36.036" grpc.time_ms=1.082 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1626gitlab # [ 328.178087] sidekiq-cluster[3368]: {"severity":"INFO","time":"2026-08-13T15:59:36.062Z","message":"Starting cluster with 1 processes"}1627gitlab # [ 328.183959] gitaly[895]: time="2026-08-13T15:59:36.091Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXXKB9SRRBN4XTJGZQPXG1C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T15:59:36.090" grpc.time_ms=0.888 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1628gitlab # [ 328.343893] gitaly[895]: time="2026-08-13T15:59:36.257Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKB9SRRBN4XTJGZQPXG1C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-13T15:59:46.159" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T15:59:36.239" grpc.time_ms=17.462 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1629gitlab # [ 328.395315] gitaly[895]: time="2026-08-13T15:59:36.308Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=33 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1433 command.oublock=0 command.real_time_ms=36 command.spawn_token_fork_ms=2 command.system_time_ms=30 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKB9SRRBN4XTJGZQPXG1C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-13T15:59:46.186" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T15:59:36.267" grpc.time_ms=40.793 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1630gitlab # [ 328.431616] gitaly[895]: time="2026-08-13T15:59:36.338Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01KZXXKB9SRRBN4XTJGZQPXG1C duration_ms=197ns method=POST pid=895 status=200 url="http://unix/api/v4/internal/post_receive"1631gitlab # [ 328.439157] gitaly[895]: time="2026-08-13T15:59:36.339Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXXKB9SRRBN4XTJGZQPXG1C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4809 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T15:59:36.139" grpc.time_ms=199.639 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1632gitlab # [ 328.463747] gitaly[895]: time="2026-08-13T15:59:36.377Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01KZXXKB9SRRBN4XTJGZQPXG1C diskcache=418237a7-18d7-482c-ab2e-d64c2c38844a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T15:59:34.800" pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1633gitlab # [ 328.490553] gitaly[895]: time="2026-08-13T15:59:36.377Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=321 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=851968 command.minflt=13062 command.oublock=32 command.real_time_ms=1547 command.spawn_token_fork_ms=2 command.system_time_ms=185 command.user_time_ms=136 component=gitaly.StreamServerInterceptor correlation_id=01KZXXKB9SRRBN4XTJGZQPXG1C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=58 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T15:59:34.800" grpc.time_ms=1577.199 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1634gitlab # [ 328.516363] systemd[1]: Finished setup-gitlab.service.1635gitlab # [ 328.517736] setup-gitlab-start[3429]: To http://gitlab/root/test-flake.git1636gitlab # [ 328.519077] setup-gitlab-start[3429]: * [new branch] master -> master1637gitlab # [ 328.520495] setup-gitlab-start[3429]: branch 'master' set up to track 'origin/master'.1638gitlab # [ 328.522374] gitlab-workhorse[821]: time="2026-08-13T15:59:36Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521639gitlab # [ 328.525042] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:15:59:36 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 16641640gitlab # [ 328.527620] systemd[1]: Starting nixbot CI service...1641gitlab: (finished: waiting for unit setup-gitlab.service, in 329.61 seconds)1642gitlab: waiting for unit nixbot.service1643gitlab # [ 329.779134] nixbot[3524]: {"ts": "2026-08-13T15:59:37.691Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1644gitlab # [ 329.803263] nixbot[3524]: {"ts": "2026-08-13T15:59:37.716Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1645gitlab # [ 329.846016] nixbot[3524]: {"ts": "2026-08-13T15:59:37.759Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1646gitlab # [ 329.854471] nixbot[3524]: {"ts": "2026-08-13T15:59:37.768Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1647gitlab # [ 329.862355] nixbot[3524]: {"ts": "2026-08-13T15:59:37.774Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1648gitlab # [ 329.872408] nixbot[3524]: {"ts": "2026-08-13T15:59:37.785Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1649gitlab # [ 329.879024] nixbot[3524]: {"ts": "2026-08-13T15:59:37.792Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1650gitlab # [ 329.885719] nixbot[3524]: {"ts": "2026-08-13T15:59:37.795Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1651gitlab # [ 329.893074] nixbot[3524]: {"ts": "2026-08-13T15:59:37.806Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1652gitlab # [ 329.899702] nixbot[3524]: {"ts": "2026-08-13T15:59:37.809Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1653gitlab # [ 329.906612] nixbot[3524]: {"ts": "2026-08-13T15:59:37.818Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1654gitlab # [ 329.916383] nixbot[3524]: {"ts": "2026-08-13T15:59:37.829Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1655gitlab # [ 329.922380] nixbot[3524]: {"ts": "2026-08-13T15:59:37.835Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1656gitlab # [ 329.929126] nixbot[3524]: {"ts": "2026-08-13T15:59:37.838Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1657gitlab # [ 329.935545] nixbot[3524]: {"ts": "2026-08-13T15:59:37.845Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1658gitlab # [ 329.941933] nixbot[3524]: {"ts": "2026-08-13T15:59:37.848Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1659gitlab # [ 329.947565] nixbot[3524]: {"ts": "2026-08-13T15:59:37.852Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1660gitlab # [ 329.952972] nixbot[3524]: {"ts": "2026-08-13T15:59:37.854Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1661gitlab # [ 329.957978] nixbot[3524]: {"ts": "2026-08-13T15:59:37.864Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1662gitlab # [ 329.962973] nixbot[3524]: {"ts": "2026-08-13T15:59:37.867Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1663gitlab # [ 329.969419] nixbot[3524]: {"ts": "2026-08-13T15:59:37.870Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1664gitlab # [ 329.974357] nixbot[3524]: {"ts": "2026-08-13T15:59:37.881Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1665gitlab # [ 329.979256] nixbot[3524]: {"ts": "2026-08-13T15:59:37.884Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1666gitlab # [ 329.983888] nixbot[3524]: {"ts": "2026-08-13T15:59:37.888Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1667gitlab # [ 329.988284] nixbot[3524]: {"ts": "2026-08-13T15:59:37.891Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1668gitlab # [ 330.486046] nixbot[3524]: INFO: Started server process [3524]1669gitlab # [ 330.489715] nixbot[3524]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1670gitlab # [ 330.510352] nixbot[3524]: INFO: ::ffff:127.0.0.1:42560 - "GET /health HTTP/1.1" 200 OK1671gitlab # [ 330.516035] systemd[1]: Started nixbot CI service.1672gitlab # [ 330.518237] systemd[1]: Reached target Multi-User System.1673gitlab # [ 330.519065] systemd[1]: Startup finished in 729ms (kernel) + 3.374s (initrd) + 5min 26.414s (userspace) = 5min 30.518s.1674gitlab # [ 331.092663] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:15:59:39 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 5831675gitlab # [ 331.101628] nixbot[3524]: {"ts": "2026-08-13T15:59:39.005Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1676gitlab # [ 331.131522] nixbot[3524]: {"ts": "2026-08-13T15:59:39.045Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1677gitlab # [ 331.306135] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:15:59:39 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1641678gitlab: (finished: waiting for unit nixbot.service, in 2.15 seconds)1679gitlab # [ 331.316499] nixbot[3524]: {"ts": "2026-08-13T15:59:39.221Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1680gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1681gitlab # [ 331.321160] nixbot[3524]: {"ts": "2026-08-13T15:59:39.223Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1682gitlab # [ 331.357681] nixbot[3524]: INFO: ::ffff:127.0.0.1:40280 - "GET /health HTTP/1.1" 200 OK1683gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.04 seconds)1684subtest: project discovered and webhook registered1685gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1686gitlab # [ 331.473223] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:15:59:39 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 711687gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.11 seconds)1688gitlab # [ 331.707504] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:15:59:39 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 3921689gitlab # [ 331.709907] nixbot[3524]: {"ts": "2026-08-13T15:59:39.623Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1690gitlab # [ 331.910495] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:15:59:39 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 1831691gitlab # [ 331.918106] nixbot[3524]: {"ts": "2026-08-13T15:59:39.824Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1692gitlab # [ 332.033458] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:15:59:39 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 1081693gitlab # [ 332.040284] nixbot[3524]: {"ts": "2026-08-13T15:59:39.948Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1694gitlab # [ 332.131521] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:15:59:40 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 831695gitlab # [ 332.139196] nixbot[3524]: {"ts": "2026-08-13T15:59:40.045Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1696gitlab # [ 332.230397] gitaly[895]: time="2026-08-13T15:59:40.143Z" level=info msg="finished unary call with code OK" catfile.duration_ms=6 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=6 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=3 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKGGRWW8Q112CW2SBM4K3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-08-13T16:00:10.015" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T15:59:40.116" grpc.time_ms=26.205 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1697gitlab # [ 332.275435] gitaly[895]: time="2026-08-13T15:59:40.173Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKGGRWW8Q112CW2SBM4K3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T16:00:10.071" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T15:59:40.172" grpc.time_ms=1.149 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1698gitlab # [ 332.299716] gitaly[895]: time="2026-08-13T15:59:40.212Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKGGRWW8Q112CW2SBM4K3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-13T15:59:50.004" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T15:59:40.195" grpc.time_ms=16.605 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1699gitlab # [ 332.350911] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:15:59:40 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 2071700gitlab # [ 332.355957] nixbot[3524]: {"ts": "2026-08-13T15:59:40.266Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1701gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1702gitlab # [ 332.486583] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:15:59:40 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1251703gitlab # [ 332.490573] nixbot[3524]: {"ts": "2026-08-13T15:59:40.403Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1704gitlab # [ 332.500815] nixbot[3524]: {"ts": "2026-08-13T15:59:40.414Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1705gitlab # [ 332.630123] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:15:59:40 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 1111706gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.16 seconds)1707(finished: subtest: project discovered and webhook registered, in 1.28 seconds)1708subtest: push delivers the webhook1709gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1710gitlab # [ 332.683829] gitaly[895]: time="2026-08-13T15:59:40.597Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=577 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01KZXXKGY7EM29Y8ZJ4Y205ECN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T15:59:40.582" grpc.time_ms=14.686 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc1711gitlab # [ 332.704449] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:15:59:40 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1111712gitlab # [ 332.771144] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:15:59:40 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 421713gitlab # [ 332.878792] gitaly[895]: time="2026-08-13T15:59:40.792Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKH1RX7JNH73Q9ABQJHPM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T15:59:40.778" pid=895 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1714gitlab # [ 332.898886] gitaly[895]: time="2026-08-13T15:59:40.792Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKH1RX7JNH73Q9ABQJHPM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T15:59:40.778" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc1715gitlab # [ 332.920059] gitlab-workhorse[821]: time="2026-08-13T15:59:40Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131716gitlab # [ 332.922676] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:15:59:40 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 1931717gitlab # [ 332.925414] gitaly[895]: time="2026-08-13T15:59:40.794Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKH1RX7JNH73Q9ABQJHPM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T15:59:40.778" grpc.time_ms=15.015 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc1718gitlab # [ 332.944558] gitaly[895]: time="2026-08-13T15:59:40.855Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=22 command.spawn_token_fork_ms=15 command.system_time_ms=7 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KZXXKH4J8MGNQ2AGZVGNJ2YY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=246 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T15:59:40.824" grpc.time_ms=25.474 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1719gitlab # Enumerating objects: 5, done.1720gitlab # [ 332.960709] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:15:59:40 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 1611721gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1722gitlab # Delta compression using up to 4 threads1723gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1724gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 273.00 KiB/s, done.1725gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1726gitlab # [ 333.014602] gitaly[895]: time="2026-08-13T15:59:40.928Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKH8JRRJ8C39Q9EQH5TRS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T15:59:40.909" pid=895 remote_ip="2001:db8:1::1" request_sha=45eeb60df18efdb426e48a9bb215d4c40d131e6a response_bytes=223 span.kind=server system=grpc1727gitlab # [ 333.027042] gitaly[895]: time="2026-08-13T15:59:40.928Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1136 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKH8JRRJ8C39Q9EQH5TRS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T15:59:40.909" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc1728gitlab # [ 333.043323] gitlab-workhorse[821]: time="2026-08-13T15:59:40Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2231729gitlab # [ 333.045606] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:15:59:40 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 1101730gitlab # [ 333.047682] gitaly[895]: time="2026-08-13T15:59:40.928Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1136 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKH8JRRJ8C39Q9EQH5TRS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T15:59:40.909" grpc.time_ms=19.016 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc1731gitlab # [ 333.183348] gitaly[895]: time="2026-08-13T15:59:41.096Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXXKHF6SCAVW2F174SV51BE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T15:59:41.086" grpc.time_ms=10.126 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc1732gitlab # [ 333.198327] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:15:59:41 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 711733gitlab # [ 333.209671] gitaly[895]: time="2026-08-13T15:59:41.123Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=4 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXXKHAST32NPD9A1PGRMCDH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-13T16:00:11.011" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-13T15:59:41.112" grpc.time_ms=11.192 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1734gitlab # [ 333.231830] gitaly[895]: time="2026-08-13T15:59:41.145Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01KZXXKHAST32NPD9A1PGRMCDH duration_ms=106ns method=POST pid=895 status=200 url="http://unix/api/v4/internal/allowed"1735gitlab # [ 333.266446] gitaly[895]: time="2026-08-13T15:59:41.179Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01KZXXKHAST32NPD9A1PGRMCDH duration_ms=33ns method=POST pid=895 status=200 url="http://unix/api/v4/internal/pre_receive"1736gitlab # [ 333.271186] gitaly[895]: time="2026-08-13T15:59:41.179Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXXKHAST32NPD9A1PGRMCDH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5315 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T15:59:41.037" grpc.time_ms=141.651 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1737gitlab # [ 333.291569] gitaly[895]: time="2026-08-13T15:59:41.200Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKHHHYQRNAPPVNZBS4018 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T15:59:41.189" pid=895 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1738gitlab # [ 333.302138] gitlab-workhorse[821]: time="2026-08-13T15:59:41Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671739gitlab # [ 333.303958] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:15:59:41 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 961740gitlab # [ 333.305977] gitaly[895]: time="2026-08-13T15:59:41.200Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKHHHYQRNAPPVNZBS4018 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T15:59:41.189" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc1741gitlab # [ 333.319822] gitaly[895]: time="2026-08-13T15:59:41.201Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKHHHYQRNAPPVNZBS4018 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T15:59:41.189" grpc.time_ms=11.25 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc1742gitlab # [ 333.334724] gitaly[895]: time="2026-08-13T15:59:41.220Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXXKHAST32NPD9A1PGRMCDH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T15:59:41.219" grpc.time_ms=0.586 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1743gitlab # [ 333.346073] gitaly[895]: time="2026-08-13T15:59:41.250Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXXKHAST32NPD9A1PGRMCDH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4784 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T15:59:41.248" grpc.time_ms=1.146 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1744gitlab # [ 333.368147] gitaly[895]: time="2026-08-13T15:59:41.281Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXXKHAST32NPD9A1PGRMCDH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T15:59:41.281" grpc.time_ms=0.412 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1745gitlab # [ 333.427828] gitaly[895]: time="2026-08-13T15:59:41.341Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01KZXXKHQ0C89W6AHDA1CBNYG8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T15:59:41.334" grpc.time_ms=7.333 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc1746gitlab # [ 333.441721] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:15:59:41 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 601747gitlab # [ 333.518194] gitaly[895]: time="2026-08-13T15:59:41.431Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01KZXXKHAST32NPD9A1PGRMCDH duration_ms=116ns method=POST pid=895 status=200 url="http://unix/api/v4/internal/post_receive"1748gitlab # [ 333.525309] gitaly[895]: time="2026-08-13T15:59:41.432Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXXKHAST32NPD9A1PGRMCDH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4809 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T15:59:41.314" grpc.time_ms=117.873 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1749gitlab # [ 333.548266] gitaly[895]: time="2026-08-13T15:59:41.438Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKHS2P9YM4NTBZAA6EY97 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T15:59:41.415" pid=895 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=214 span.kind=server system=grpc1750gitlab # [ 333.567945] gitlab-workhorse[821]: time="2026-08-13T15:59:41Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2141751gitlab # To http://gitlab/root/test-flake.git1752gitlab # [ 333.571654] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:15:59:41 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 214 "" "git/2.55.0" 921753gitlab # c63bd0c..a19390f [ 333.575376] gitlab-workhorse[821]: time="2026-08-13T15:59:41Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521754gitlab # master -> master[ 333.580208] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:15:59:41 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 5771755gitlab # 1756gitlab # [ 333.582622] gitaly[895]: time="2026-08-13T15:59:41.438Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1102 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=2 command.system_time_ms=18 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKHS2P9YM4NTBZAA6EY97 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T15:59:41.415" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc1757gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.96 seconds)1758gitlab: must succeed: git -C /tmp/test-flake rev-parse master1759gitlab # [ 333.597622] gitaly[895]: time="2026-08-13T15:59:41.438Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1102 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=2 command.system_time_ms=18 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKHS2P9YM4NTBZAA6EY97 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T15:59:41.415" grpc.time_ms=23.011 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc1760gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.02 seconds)1761gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1762gitlab # [ 333.612053] gitaly[895]: time="2026-08-13T15:59:41.466Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01KZXXKHAST32NPD9A1PGRMCDH diskcache=35a02645-0d3b-44a9-9947-f027bc782fc4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T15:59:40.973" pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1763gitlab # [ 333.622129] gitaly[895]: time="2026-08-13T15:59:41.466Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=142 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=847872 command.minflt=13028 command.oublock=32 command.real_time_ms=464 command.spawn_token_fork_ms=3 command.system_time_ms=84 command.user_time_ms=58 component=gitaly.StreamServerInterceptor correlation_id=01KZXXKHAST32NPD9A1PGRMCDH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=58 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T15:59:40.973" grpc.time_ms=492.987 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1764gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.08 seconds)1765gitlab # [ 333.690010] gitaly[895]: time="2026-08-13T15:59:41.603Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKHYBQV6GSR1GY1CC9BRA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T16:00:11.502" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T15:59:41.602" grpc.time_ms=0.709 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1766gitlab # [ 333.712987] nixbot[3524]: INFO: ::ffff:127.0.0.1:40294 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1767gitlab # [ 333.729581] gitaly[895]: time="2026-08-13T15:59:41.643Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=590 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXXKHYBQV6GSR1GY1CC9BRA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-13T16:00:11.532" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T15:59:41.633" grpc.time_ms=10.03 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1768gitlab # [ 333.756294] gitaly[895]: time="2026-08-13T15:59:41.669Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=3 command.system_time_ms=0 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01KZXXKHYBQV6GSR1GY1CC9BRA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T15:59:51.040" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T15:59:41.661" grpc.time_ms=8.763 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1769gitlab # [ 333.791091] gitaly[895]: time="2026-08-13T15:59:41.704Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXXKHYBQV6GSR1GY1CC9BRA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T15:59:51.075" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T15:59:41.696" grpc.time_ms=8.272 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1770gitlab # [ 333.901595] gitaly[895]: time="2026-08-13T15:59:41.815Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKHYBQV6GSR1GY1CC9BRA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-13T15:59:51.193" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T15:59:41.814" grpc.time_ms=0.614 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1771gitlab # [ 333.934007] gitaly[895]: time="2026-08-13T15:59:41.847Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=569 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKHYBQV6GSR1GY1CC9BRA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-13T15:59:51.209" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T15:59:41.830" grpc.time_ms=17.284 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1772gitlab # [ 334.012241] gitaly[895]: time="2026-08-13T15:59:41.925Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXXKHYBQV6GSR1GY1CC9BRA grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4153 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T15:59:41.924" grpc.time_ms=0.848 pid=895 span.kind=server system=grpc1773gitlab # [ 334.060755] gitaly[895]: time="2026-08-13T15:59:41.974Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXXKHYBQV6GSR1GY1CC9BRA grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T15:59:41.973" grpc.time_ms=0.929 pid=895 span.kind=server system=grpc1774gitlab # [ 334.095087] gitaly[895]: time="2026-08-13T15:59:42.008Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKHYBQV6GSR1GY1CC9BRA diskcache=6c18a4df-f087-4c86-9df9-5d53f2cda674 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-13T15:59:51.231" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T15:59:41.852" pid=895 ref=refs/keep-around/c63bd0c49cf6bac627c947e375677c7c8d555c39 remote_ip="2001:db8:1::1" revision=c63bd0c49cf6bac627c947e375677c7c8d555c39 span.kind=server system=grpc username=root1775gitlab # [ 334.124985] gitaly[895]: time="2026-08-13T15:59:42.009Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=134 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5498 command.oublock=8 command.real_time_ms=148 command.spawn_token_fork_ms=2 command.system_time_ms=70 command.user_time_ms=64 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKHYBQV6GSR1GY1CC9BRA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-13T15:59:51.231" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T15:59:41.852" grpc.time_ms=156.743 pid=895 ref=refs/keep-around/c63bd0c49cf6bac627c947e375677c7c8d555c39 remote_ip="2001:db8:1::1" revision=c63bd0c49cf6bac627c947e375677c7c8d555c39 span.kind=server system=grpc username=root1776gitlab # [ 334.150645] gitaly[895]: time="2026-08-13T15:59:42.016Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKHYBQV6GSR1GY1CC9BRA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T16:00:12.014" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T15:59:42.015" grpc.time_ms=0.605 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1777gitlab # [ 334.393801] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:15:59:42 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/c63bd0c49cf6bac627c947e375677c7c8d555c39 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 7901778gitlab # [ 334.402021] nixbot[3524]: {"ts": "2026-08-13T15:59:42.308Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/c63bd0c49cf6bac627c947e375677c7c8d555c39 \"HTTP/1.1 201 Created\""}1779gitlab # [ 334.410728] nixbot[3524]: {"ts": "2026-08-13T15:59:42.322Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-c63bd0c49cf6-0"}1780gitlab # [ 334.482338] systemd[1]: Started Nix Daemon.1781gitlab # [ 334.597796] nix-daemon[3737]: accepted connection from pid 3731, user nixbot1782gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1783gitlab # [ 334.731523] nix-daemon[3737]: accepted connection from pid 3744, user nixbot1784gitlab # [ 334.763164] nixbot[3524]: {"ts": "2026-08-13T15:59:42.675Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-c63bd0c49cf6-0", "argv0": "bwrap"}1785gitlab # [ 334.826763] nixbot[3524]: INFO: ::ffff:127.0.0.1:40302 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1786gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.13 seconds)1787gitlab # [ 335.006435] nix-daemon[3737]: accepted connection from pid 3757, user nixbot1788gitlab # [ 335.083481] nix-daemon[3737]: accepted connection from pid 3767, user nixbot1789gitlab # [ 335.103708] nix-daemon[3737]: accepted connection from pid 3757, user nixbot1790gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1791gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.05 seconds)1792gitlab # [ 335.887548] nixbot[3524]: INFO: ::ffff:127.0.0.1:40304 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1793gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1794gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.05 seconds)1795gitlab # [ 336.940476] nixbot[3524]: INFO: ::ffff:127.0.0.1:40308 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1796gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1797gitlab # [ 337.995357] nixbot[3524]: INFO: ::ffff:127.0.0.1:40314 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1798gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.06 seconds)1799gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1800gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.05 seconds)1801gitlab # [ 339.050316] nixbot[3524]: INFO: ::ffff:127.0.0.1:40324 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1802gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1803gitlab # [ 340.110988] nixbot[3524]: INFO: ::ffff:127.0.0.1:40326 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1804gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.06 seconds)1805gitlab # [ 340.198356] gitaly[895]: time="2026-08-13T15:59:48.110Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKR91SF8Y8NEE85VGPXGJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T16:00:18.008" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T15:59:48.109" grpc.time_ms=1.316 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1806gitlab # [ 340.317301] gitaly[895]: time="2026-08-13T15:59:48.230Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXXKR91SF8Y8NEE85VGPXGJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T15:59:58.132" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T15:59:48.212" grpc.time_ms=17.962 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1807gitlab # [ 340.465677] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:15:59:48 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/c63bd0c49cf6bac627c947e375677c7c8d555c39 HTTP/1.1" 201 670 "" "python-httpx/0.28.1" 3751808gitlab # [ 340.476627] nixbot[3524]: {"ts": "2026-08-13T15:59:48.389Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/c63bd0c49cf6bac627c947e375677c7c8d555c39 \"HTTP/1.1 201 Created\""}1809gitlab # [ 340.785898] gitaly[895]: time="2026-08-13T15:59:48.699Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKRNETBK2YHWDN2G1N513 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T16:00:18.096" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T15:59:48.697" grpc.time_ms=1.108 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1810gitlab # [ 341.067662] gitaly[895]: time="2026-08-13T15:59:48.980Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXXKRNETBK2YHWDN2G1N513 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T15:59:58.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T15:59:48.961" grpc.time_ms=19.366 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1811gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1812gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.06 seconds)1813gitlab # [ 341.169975] nixbot[3524]: INFO: ::ffff:127.0.0.1:54628 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1814gitlab # [ 341.242793] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:15:59:49 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/c63bd0c49cf6bac627c947e375677c7c8d555c39 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 7571815gitlab # [ 341.251219] nixbot[3524]: {"ts": "2026-08-13T15:59:49.157Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/c63bd0c49cf6bac627c947e375677c7c8d555c39 \"HTTP/1.1 201 Created\""}1816gitlab # [ 341.321187] gitaly[895]: time="2026-08-13T15:59:49.234Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKSDMJRATCQAS4C2PT58Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T16:00:19.132" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T15:59:49.232" grpc.time_ms=0.969 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1817gitlab # [ 341.388605] gitaly[895]: time="2026-08-13T15:59:49.302Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXXKSDMJRATCQAS4C2PT58Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T15:59:59.099" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T15:59:49.290" grpc.time_ms=11.528 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1818gitlab # [ 341.489187] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:15:59:49 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/c63bd0c49cf6bac627c947e375677c7c8d555c39 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2281819gitlab # [ 341.503220] nixbot[3524]: {"ts": "2026-08-13T15:59:49.412Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/c63bd0c49cf6bac627c947e375677c7c8d555c39 \"HTTP/1.1 201 Created\""}1820gitlab # [ 341.662760] nix-daemon[3737]: accepted connection from pid 3809, user nixbot1821gitlab # [ 341.855684] gitaly[895]: time="2026-08-13T15:59:49.769Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=577 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZXXKSWZSTN9XBVNBBQBN3XW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T15:59:49.753" grpc.time_ms=15.757 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc1822gitlab # [ 341.896633] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:15:59:49 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1061823gitlab # [ 341.954798] gitaly[895]: time="2026-08-13T15:59:49.868Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKT0CBQPA7PQ0N82YJJAV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T15:59:49.853" pid=895 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1824gitlab # [ 341.986028] gitaly[895]: time="2026-08-13T15:59:49.868Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKT0CBQPA7PQ0N82YJJAV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T15:59:49.853" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc1825gitlab # [ 342.017580] gitlab-workhorse[821]: time="2026-08-13T15:59:49Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671826gitlab # [ 342.021000] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:15:59:49 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 971827gitlab # [ 342.024223] gitaly[895]: time="2026-08-13T15:59:49.869Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKT0CBQPA7PQ0N82YJJAV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T15:59:49.853" grpc.time_ms=15.221 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc1828gitlab # [ 342.054938] gitaly[895]: time="2026-08-13T15:59:49.968Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKT3M8TCG2WHV43WAA6B4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T15:59:49.940" pid=895 remote_ip="2001:db8:1::1" request_sha=6f92b8883d85de9edc273c14ffeeb62e5d16004e response_bytes=336 span.kind=server system=grpc1829gitlab # [ 342.074627] gitaly[895]: time="2026-08-13T15:59:49.968Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1129 command.oublock=0 command.real_time_ms=22 command.spawn_token_fork_ms=2 command.system_time_ms=16 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKT3M8TCG2WHV43WAA6B4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T15:59:49.940" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc1830gitlab # [ 342.099444] gitlab-workhorse[821]: time="2026-08-13T15:59:49Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3361831gitlab # [ 342.102662] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:15:59:49 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 336 "" "git/2.55.0" 931832gitlab # [ 342.105796] gitaly[895]: time="2026-08-13T15:59:49.969Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1129 command.oublock=0 command.real_time_ms=22 command.spawn_token_fork_ms=2 command.system_time_ms=16 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKT3M8TCG2WHV43WAA6B4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T15:59:49.940" grpc.time_ms=28.601 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc1833gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1834gitlab # [ 342.201577] nix-daemon[3737]: accepted connection from pid 3839, user nixbot1835gitlab # [ 342.225514] nixbot[3524]: INFO: ::ffff:127.0.0.1:54640 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1836gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.06 seconds)1837gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1838gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.05 seconds)1839gitlab # [ 343.280505] nixbot[3524]: INFO: ::ffff:127.0.0.1:54654 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1840gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1841gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.05 seconds)1842gitlab # [ 344.332433] nixbot[3524]: INFO: ::ffff:127.0.0.1:54658 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1843gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1844gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.05 seconds)1845gitlab # [ 345.384710] nixbot[3524]: INFO: ::ffff:127.0.0.1:54662 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1846gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1847gitlab # [ 346.437645] nixbot[3524]: INFO: ::ffff:127.0.0.1:54678 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1848gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.05 seconds)1849gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1850gitlab # [ 347.492714] nixbot[3524]: INFO: ::ffff:127.0.0.1:54692 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1851gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.05 seconds)1852gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1853gitlab # [ 348.547608] nixbot[3524]: INFO: ::ffff:127.0.0.1:54706 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1854gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.05 seconds)1855gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1856gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.05 seconds)1857gitlab # [ 349.603028] nixbot[3524]: INFO: ::ffff:127.0.0.1:54708 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1858gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1859gitlab # [ 350.655875] nixbot[3524]: INFO: ::ffff:127.0.0.1:54720 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1860gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.05 seconds)1861gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1862gitlab # [ 351.711246] nixbot[3524]: INFO: ::ffff:127.0.0.1:48786 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1863gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.06 seconds)1864gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1865gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.05 seconds)1866gitlab # [ 352.768123] nixbot[3524]: INFO: ::ffff:127.0.0.1:48798 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1867gitlab # [ 353.084653] systemd[1]: Starting Logrotate Service...1868gitlab # [ 353.215978] systemd[1]: logrotate.service: Deactivated successfully.1869gitlab # [ 353.217671] systemd[1]: Finished Logrotate Service.1870gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1871gitlab # [ 353.821589] nixbot[3524]: INFO: ::ffff:127.0.0.1:48806 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1872gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.06 seconds)1873gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1874gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.05 seconds)1875gitlab # [ 354.876313] nixbot[3524]: INFO: ::ffff:127.0.0.1:48816 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1876gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1877gitlab # [ 355.929370] nixbot[3524]: INFO: ::ffff:127.0.0.1:48818 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1878gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.06 seconds)1879gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1880gitlab # [ 356.983609] nixbot[3524]: INFO: ::ffff:127.0.0.1:48832 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1881gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.05 seconds)1882gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1883gitlab # [ 358.038160] nixbot[3524]: INFO: ::ffff:127.0.0.1:48838 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1884gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.06 seconds)1885gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1886gitlab # [ 359.094461] nixbot[3524]: INFO: ::ffff:127.0.0.1:48854 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1887gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.06 seconds)1888gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1889gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.05 seconds)1890gitlab # [ 360.148986] nixbot[3524]: INFO: ::ffff:127.0.0.1:48870 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1891gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1892gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.05 seconds)1893gitlab # [ 361.202594] nixbot[3524]: INFO: ::ffff:127.0.0.1:40204 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1894gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1895gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.05 seconds)1896gitlab # [ 362.255891] nixbot[3524]: INFO: ::ffff:127.0.0.1:40208 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1897gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1898gitlab # [ 363.308210] nixbot[3524]: INFO: ::ffff:127.0.0.1:40218 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1899gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.05 seconds)1900gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1901gitlab # [ 364.363396] nixbot[3524]: INFO: ::ffff:127.0.0.1:40228 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1902gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.06 seconds)1903gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1904gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.05 seconds)1905gitlab # [ 365.418326] nixbot[3524]: INFO: ::ffff:127.0.0.1:40232 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1906gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1907gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.05 seconds)1908gitlab # [ 366.470614] nixbot[3524]: INFO: ::ffff:127.0.0.1:40234 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1909gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1910gitlab # [ 367.522130] nixbot[3524]: INFO: ::ffff:127.0.0.1:40242 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1911gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.05 seconds)1912gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1913gitlab # [ 368.577152] nixbot[3524]: INFO: ::ffff:127.0.0.1:40248 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1914gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.05 seconds)1915gitlab # [ 368.833686] sidekiq-cluster[3502]: 2026-08-13T16:00:16.745Z pid=3502 tid=ykm INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>3502, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>425357312}1916gitlab # [ 369.115150] sidekiq-cluster[3502]: W, [2026-08-13T16:00:17.028603 #3502] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1917gitlab # [ 369.253629] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:00:17.167Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1918gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1919gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.05 seconds)1920gitlab # [ 369.634613] nixbot[3524]: INFO: ::ffff:127.0.0.1:40262 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1921gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1922gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.05 seconds)1923gitlab # [ 370.687976] nixbot[3524]: INFO: ::ffff:127.0.0.1:40276 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1924gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1925gitlab # [ 371.740752] nixbot[3524]: INFO: ::ffff:127.0.0.1:55532 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1926gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.05 seconds)1927gitlab # [ 372.279190] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:00:20.191Z","message":"GitLab reliable fetch activated!"}1928gitlab # [ 372.284424] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:00:20.191Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1929gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1930gitlab # [ 372.795584] nixbot[3524]: INFO: ::ffff:127.0.0.1:55534 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1931gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.06 seconds)1932gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1933gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.05 seconds)1934gitlab # [ 373.851166] nixbot[3524]: INFO: ::ffff:127.0.0.1:55548 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1935gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1936gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.05 seconds)1937gitlab # [ 374.903712] nixbot[3524]: INFO: ::ffff:127.0.0.1:55558 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1938gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1939gitlab # [ 375.956599] nixbot[3524]: INFO: ::ffff:127.0.0.1:55560 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1940gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.05 seconds)1941gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1942gitlab # [ 377.011131] nixbot[3524]: INFO: ::ffff:127.0.0.1:55562 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1943gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.05 seconds)1944gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1945gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.05 seconds)1946gitlab # [ 378.066678] nixbot[3524]: INFO: ::ffff:127.0.0.1:55568 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1947gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1948gitlab # [ 379.118754] nixbot[3524]: INFO: ::ffff:127.0.0.1:55576 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1949gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.05 seconds)1950gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1951gitlab # [ 380.174392] nixbot[3524]: INFO: ::ffff:127.0.0.1:55592 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1952gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.06 seconds)1953gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1954gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.05 seconds)1955gitlab # [ 381.231180] nixbot[3524]: INFO: ::ffff:127.0.0.1:45894 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1956gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1957gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.05 seconds)1958gitlab # [ 382.285919] nixbot[3524]: INFO: ::ffff:127.0.0.1:45896 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1959gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1960gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.05 seconds)1961gitlab # [ 383.339251] nixbot[3524]: INFO: ::ffff:127.0.0.1:45906 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1962gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1963gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.05 seconds)1964gitlab # [ 384.392174] nixbot[3524]: INFO: ::ffff:127.0.0.1:45920 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1965gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1966gitlab # [ 385.445050] nixbot[3524]: INFO: ::ffff:127.0.0.1:45928 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1967gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.06 seconds)1968gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1969gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.05 seconds)1970gitlab # [ 386.501324] nixbot[3524]: INFO: ::ffff:127.0.0.1:45942 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1971gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1972gitlab # [ 387.554574] nixbot[3524]: INFO: ::ffff:127.0.0.1:45944 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1973gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.06 seconds)1974gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1975gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.05 seconds)1976gitlab # [ 388.611255] nixbot[3524]: INFO: ::ffff:127.0.0.1:45946 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1977gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1978gitlab # [ 389.662845] nixbot[3524]: INFO: ::ffff:127.0.0.1:45948 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1979gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.05 seconds)1980gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1981gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.05 seconds)1982gitlab # [ 390.719893] nixbot[3524]: INFO: ::ffff:127.0.0.1:45954 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1983gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1984gitlab # [ 391.773307] nixbot[3524]: INFO: ::ffff:127.0.0.1:40950 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1985gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.06 seconds)1986gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1987gitlab # [ 392.831368] nixbot[3524]: INFO: ::ffff:127.0.0.1:40964 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1988gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.06 seconds)1989gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1990gitlab # [ 393.886848] nixbot[3524]: INFO: ::ffff:127.0.0.1:40968 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1991gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.06 seconds)1992gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1993gitlab # [ 394.942977] nixbot[3524]: INFO: ::ffff:127.0.0.1:40984 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1994gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.06 seconds)1995gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1996gitlab # [ 395.997650] nixbot[3524]: INFO: ::ffff:127.0.0.1:41000 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK1997gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.06 seconds)1998gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'1999gitlab # [ 397.053519] nixbot[3524]: INFO: ::ffff:127.0.0.1:41010 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK2000gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.06 seconds)2001gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'2002gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.05 seconds)2003gitlab # [ 398.109065] nixbot[3524]: INFO: ::ffff:127.0.0.1:41014 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK2004gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'2005gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.05 seconds)2006gitlab # [ 399.162955] nixbot[3524]: INFO: ::ffff:127.0.0.1:41018 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK2007gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'2008gitlab # [ 400.217292] nixbot[3524]: INFO: ::ffff:127.0.0.1:41024 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK2009gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.06 seconds)2010gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'2011gitlab # [ 401.269211] nixbot[3524]: INFO: ::ffff:127.0.0.1:37840 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK2012gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.05 seconds)2013gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'2014gitlab # [ 402.324730] nixbot[3524]: INFO: ::ffff:127.0.0.1:37848 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK2015gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.06 seconds)2016gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'2017gitlab # [ 403.382995] nixbot[3524]: INFO: ::ffff:127.0.0.1:37862 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK2018gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.06 seconds)2019gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'2020gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.05 seconds)2021gitlab # [ 404.439173] nixbot[3524]: INFO: ::ffff:127.0.0.1:37870 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK2022gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'2023gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.05 seconds)2024gitlab # [ 405.494858] nixbot[3524]: INFO: ::ffff:127.0.0.1:37872 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK2025gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'2026gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.04 seconds)2027gitlab # [ 406.540173] nixbot[3524]: INFO: ::ffff:127.0.0.1:37876 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK2028gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'2029gitlab # [ 407.596546] nixbot[3524]: INFO: ::ffff:127.0.0.1:37886 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK2030gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.06 seconds)2031gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'2032gitlab # [ 408.654927] nixbot[3524]: INFO: ::ffff:127.0.0.1:37896 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK2033gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.06 seconds)2034gitlab # [ 408.734174] postgres[4059]: [4059] ERROR: relation "table_without_models" does not exist2035gitlab # [ 408.737752] postgres[4059]: [4059] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')2036gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'2037gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.06 seconds)2038gitlab # [ 409.711812] nixbot[3524]: INFO: ::ffff:127.0.0.1:37898 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK2039gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'2040gitlab # [ 410.766582] nixbot[3524]: INFO: ::ffff:127.0.0.1:37902 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK2041gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.06 seconds)2042gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'2043gitlab # [ 411.823855] nixbot[3524]: INFO: ::ffff:127.0.0.1:35838 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK2044gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.06 seconds)2045gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'2046gitlab # [ 412.880638] nixbot[3524]: INFO: ::ffff:127.0.0.1:35844 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK2047gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.06 seconds)2048gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'2049gitlab # [ 413.898137] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:01.811Z","message":"Booted Rails 7.2.3.1 application in production environment"}2050gitlab # [ 413.902397] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:01.816Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}2051gitlab # [ 413.904851] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:01.818Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}2052gitlab # [ 413.906825] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:01.820Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}2053gitlab # [ 413.916304] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:01.824Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2054gitlab # [ 413.939935] nixbot[3524]: INFO: ::ffff:127.0.0.1:35860 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK2055gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.06 seconds)2056gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'2057gitlab # [ 414.997284] nixbot[3524]: INFO: ::ffff:127.0.0.1:35874 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK2058gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.06 seconds)2059gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'2060gitlab # [ 416.053039] nixbot[3524]: INFO: ::ffff:127.0.0.1:35882 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK2061gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.06 seconds)2062gitlab # [ 416.565289] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:04.476Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"6f6095e121847a712111f490","created_at":"2026-08-13T15:59:32.994Z","trace_propagation_headers":{"sentry-trace":"a4c9e68742c54f6c813385f695bb3620-c027029150f044d4","baggage":"sentry-trace_id=a4c9e68742c54f6c813385f695bb3620,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXXK7NAMBW2QJNDVTTWY4A1","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:33.050Z","job_size_bytes":2,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-6f6095e121847a712111f490: start","job_status":"start","queue_duration_s":91.426186,"scheduling_latency_s":91.426287}2063gitlab # [ 416.958099] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:04.870Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"6f6095e121847a712111f490","created_at":"2026-08-13T15:59:32.994Z","trace_propagation_headers":{"sentry-trace":"a4c9e68742c54f6c813385f695bb3620-c027029150f044d4","baggage":"sentry-trace_id=a4c9e68742c54f6c813385f695bb3620,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXXK7NAMBW2QJNDVTTWY4A1","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:33.050Z","job_size_bytes":2,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-6f6095e121847a712111f490: done: 0.394189 sec","job_status":"done","queue_duration_s":91.426186,"scheduling_latency_s":91.426287,"redis_calls":23,"redis_duration_s":0.010466,"redis_read_bytes":910,"redis_write_bytes":2540,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.00569,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002789,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001987,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.210997,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.20852034,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.394189,"completed_at":"2026-08-13T16:01:04.870Z","load_balancing_strategy":"primary","db_duration_s":0.105772,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2064gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'2065gitlab # [ 417.057645] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:04.873Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"8c45aeecabf2f55195a989c2","created_at":"2026-08-13T15:59:33.067Z","trace_propagation_headers":{"sentry-trace":"a4c9e68742c54f6c813385f695bb3620-c027029150f044d4","baggage":"sentry-trace_id=a4c9e68742c54f6c813385f695bb3620,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXXK7NAMBW2QJNDVTTWY4A1","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:33.075Z","job_size_bytes":2,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-8c45aeecabf2f55195a989c2: start","job_status":"start","queue_duration_s":91.798022,"scheduling_latency_s":91.798062}2066gitlab # [ 417.109250] nixbot[3524]: INFO: ::ffff:127.0.0.1:35888 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK2067gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.05 seconds)2068gitlab # [ 417.146537] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:05.059Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"8c45aeecabf2f55195a989c2","created_at":"2026-08-13T15:59:33.067Z","trace_propagation_headers":{"sentry-trace":"a4c9e68742c54f6c813385f695bb3620-c027029150f044d4","baggage":"sentry-trace_id=a4c9e68742c54f6c813385f695bb3620,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXXK7NAMBW2QJNDVTTWY4A1","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:33.075Z","job_size_bytes":2,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-8c45aeecabf2f55195a989c2: done: 0.186014 sec","job_status":"done","queue_duration_s":91.798022,"scheduling_latency_s":91.798062,"redis_calls":14,"redis_duration_s":0.0049759999999999995,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000935,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002492,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001549,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.13955,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.14427656,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.186014,"completed_at":"2026-08-13T16:01:05.059Z","load_balancing_strategy":"primary","db_duration_s":0.03551,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2069gitlab # [ 417.233940] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:05.062Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"6e9ffe5d7110f2720d2be483","created_at":"2026-08-13T15:59:33.687Z","trace_propagation_headers":{"sentry-trace":"a4c9e68742c54f6c813385f695bb3620-c027029150f044d4","baggage":"sentry-trace_id=a4c9e68742c54f6c813385f695bb3620,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXXK7NAMBW2QJNDVTTWY4A1","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:33.695Z","job_size_bytes":5,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-6e9ffe5d7110f2720d2be483: start","job_status":"start","queue_duration_s":91.367035,"scheduling_latency_s":91.367072}2070gitlab # [ 417.378471] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:05.291Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"6e9ffe5d7110f2720d2be483","created_at":"2026-08-13T15:59:33.687Z","trace_propagation_headers":{"sentry-trace":"a4c9e68742c54f6c813385f695bb3620-c027029150f044d4","baggage":"sentry-trace_id=a4c9e68742c54f6c813385f695bb3620,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXXK7NAMBW2QJNDVTTWY4A1","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:33.695Z","job_size_bytes":5,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-6e9ffe5d7110f2720d2be483: done: 0.229303 sec","job_status":"done","queue_duration_s":91.367035,"scheduling_latency_s":91.367072,"redis_calls":12,"redis_duration_s":0.0035380000000000003,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000879,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002063,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000596,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.179291,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037108,"duration_s":0.229303,"completed_at":"2026-08-13T16:01:05.291Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.042065,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2071gitlab # [ 417.494791] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:05.293Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"aa677de62d81793ac302748d","created_at":"2026-08-13T15:59:33.730Z","trace_propagation_headers":{"sentry-trace":"a4c9e68742c54f6c813385f695bb3620-c027029150f044d4","baggage":"sentry-trace_id=a4c9e68742c54f6c813385f695bb3620,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXXK7NAMBW2QJNDVTTWY4A1","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:33.736Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-aa677de62d81793ac302748d: start","job_status":"start","queue_duration_s":91.557031,"scheduling_latency_s":91.55705}2072gitlab # [ 417.651985] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:05.563Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"aa677de62d81793ac302748d","created_at":"2026-08-13T15:59:33.730Z","trace_propagation_headers":{"sentry-trace":"a4c9e68742c54f6c813385f695bb3620-c027029150f044d4","baggage":"sentry-trace_id=a4c9e68742c54f6c813385f695bb3620,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXXK7NAMBW2QJNDVTTWY4A1","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:33.736Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-aa677de62d81793ac302748d: done: 0.270554 sec","job_status":"done","queue_duration_s":91.557031,"scheduling_latency_s":91.55705,"redis_calls":11,"redis_duration_s":0.003212,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000723,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001881,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000608,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.04,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.228,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.228,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.039,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.168874,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0005954,"duration_s":0.270554,"completed_at":"2026-08-13T16:01:05.563Z","load_balancing_strategy":"primary","db_duration_s":0.105185,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2073gitlab # [ 417.748562] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:05.566Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"fde64f9199c75cdc8f753754","created_at":"2026-08-13T15:59:33.740Z","trace_propagation_headers":{"sentry-trace":"a4c9e68742c54f6c813385f695bb3620-c027029150f044d4","baggage":"sentry-trace_id=a4c9e68742c54f6c813385f695bb3620,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXXK7NAMBW2QJNDVTTWY4A1","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:33.745Z","job_size_bytes":89,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-fde64f9199c75cdc8f753754: start","job_status":"start","queue_duration_s":91.8208,"scheduling_latency_s":91.820828}2074gitlab # [ 417.769263] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:05.614Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"fde64f9199c75cdc8f753754","created_at":"2026-08-13T15:59:33.740Z","trace_propagation_headers":{"sentry-trace":"a4c9e68742c54f6c813385f695bb3620-c027029150f044d4","baggage":"sentry-trace_id=a4c9e68742c54f6c813385f695bb3620,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXXK7NAMBW2QJNDVTTWY4A1","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:33.745Z","job_size_bytes":89,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-fde64f9199c75cdc8f753754: done: 0.048094 sec","job_status":"done","queue_duration_s":91.8208,"scheduling_latency_s":91.820828,"redis_calls":11,"redis_duration_s":0.003155,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000792,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001759,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000604,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031475,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004261,"duration_s":0.048094,"completed_at":"2026-08-13T16:01:05.614Z","load_balancing_strategy":"primary","db_duration_s":0.007879,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2075gitlab # [ 417.816088] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:05.616Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 c63bd0c49cf6bac627c947e375677c7c8d555c39 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"b0cdbc4bc4d49393e2086fa3","created_at":"2026-08-13T15:59:36.204Z","trace_propagation_headers":{"sentry-trace":"b0f29b1d8e2f4f118927dcd642e1b365-c1af20b6b4ed4cb9","baggage":"sentry-trace_id=b0f29b1d8e2f4f118927dcd642e1b365,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXXKB9SRRBN4XTJGZQPXG1C","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:36.212Z","job_size_bytes":185,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-b0cdbc4bc4d49393e2086fa3: start","job_status":"start","queue_duration_s":89.403579,"scheduling_latency_s":89.403603}2076gitlab # [ 417.862841] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:05.636Z","message":"changes: \"0000000000000000000000000000000000000000 c63bd0c49cf6bac627c947e375677c7c8d555c39 refs/heads/master\\n\""}2077gitlab # [ 417.869264] gitaly[895]: time="2026-08-13T16:01:05.688Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZXXKB9SRRBN4XTJGZQPXG1C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T16:01:15.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T16:01:05.669" grpc.time_ms=18.036 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2078gitlab # [ 417.897227] gitaly[895]: time="2026-08-13T16:01:05.711Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=3 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKB9SRRBN4XTJGZQPXG1C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-13T16:01:15.034" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T16:01:05.694" grpc.time_ms=16.852 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2079gitlab # [ 417.918451] gitaly[895]: time="2026-08-13T16:01:05.782Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZXXKB9SRRBN4XTJGZQPXG1C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-13T16:01:15.111" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T16:01:05.771" grpc.time_ms=11.38 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2080gitlab # [ 417.935791] gitaly[895]: time="2026-08-13T16:01:05.839Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXXKB9SRRBN4XTJGZQPXG1C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3936 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T16:01:05.838" grpc.time_ms=0.581 pid=895 span.kind=server system=grpc2081gitlab # [ 417.969023] gitaly[895]: time="2026-08-13T16:01:05.882Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXXKB9SRRBN4XTJGZQPXG1C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3938 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T16:01:05.880" grpc.time_ms=1.769 pid=895 span.kind=server system=grpc2082gitlab # [ 417.999106] gitaly[895]: time="2026-08-13T16:01:05.896Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKB9SRRBN4XTJGZQPXG1C diskcache=021b47bf-3501-4333-82ea-1d9a53583ab8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-13T16:01:15.135" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T16:01:05.796" pid=895 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2083gitlab # [ 418.022579] gitaly[895]: time="2026-08-13T16:01:05.896Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=102 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=4933 command.oublock=8 command.real_time_ms=94 command.spawn_token_fork_ms=1 command.system_time_ms=55 command.user_time_ms=47 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKB9SRRBN4XTJGZQPXG1C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-13T16:01:15.135" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T16:01:05.796" grpc.time_ms=100.54 pid=895 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2084gitlab # [ 418.045102] gitaly[895]: time="2026-08-13T16:01:05.920Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKB9SRRBN4XTJGZQPXG1C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-13T16:01:15.259" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T16:01:05.920" grpc.time_ms=0.265 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2085gitlab # [ 418.059545] gitaly[895]: time="2026-08-13T16:01:05.950Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=860 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=3 command.system_time_ms=15 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKB9SRRBN4XTJGZQPXG1C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-13T16:01:15.266" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T16:01:05.927" grpc.time_ms=22.866 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2086gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'2087gitlab # [ 418.174983] nixbot[3524]: INFO: ::ffff:127.0.0.1:35892 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK2088gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.07 seconds)2089gitlab # [ 418.219192] gitaly[895]: time="2026-08-13T16:01:06.132Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=312 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXXKB9SRRBN4XTJGZQPXG1C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-08-13T16:01:36.019" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T16:01:06.120" grpc.time_ms=12.317 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2090gitlab # [ 418.284570] gitaly[895]: time="2026-08-13T16:01:06.198Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKB9SRRBN4XTJGZQPXG1C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-13T16:01:16.006" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T16:01:06.197" grpc.time_ms=0.711 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2091gitlab # [ 418.315881] gitaly[895]: time="2026-08-13T16:01:06.214Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=316 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXXKB9SRRBN4XTJGZQPXG1C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-13T16:01:16.011" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-08-13T16:01:06.202" grpc.time_ms=11.549 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2092gitlab # [ 418.346604] gitaly[895]: time="2026-08-13T16:01:06.260Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXXKB9SRRBN4XTJGZQPXG1C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T16:01:16.051" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T16:01:06.242" grpc.time_ms=17.513 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2093gitlab # [ 418.376682] gitaly[895]: time="2026-08-13T16:01:06.290Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=10 component=gitaly.StreamServerInterceptor correlation_id=01KZXXKB9SRRBN4XTJGZQPXG1C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T16:01:16.081" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T16:01:06.272" grpc.time_ms=18.136 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2094gitlab # [ 418.428901] gitaly[895]: time="2026-08-13T16:01:06.342Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=882 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=3 command.system_time_ms=16 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZXXKB9SRRBN4XTJGZQPXG1C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-13T16:01:36.213" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T16:01:06.314" grpc.time_ms=27.946 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2095gitlab # [ 419.118803] gitaly[895]: time="2026-08-13T16:01:07.031Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXXKB9SRRBN4XTJGZQPXG1C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-13T16:01:17.008" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T16:01:07.029" grpc.time_ms=2.445 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2096gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'2097gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.06 seconds)2098gitlab # [ 419.196076] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:07.107Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 c63bd0c49cf6bac627c947e375677c7c8d555c39 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"b0cdbc4bc4d49393e2086fa3","created_at":"2026-08-13T15:59:36.204Z","trace_propagation_headers":{"sentry-trace":"b0f29b1d8e2f4f118927dcd642e1b365-c1af20b6b4ed4cb9","baggage":"sentry-trace_id=b0f29b1d8e2f4f118927dcd642e1b365,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXXKB9SRRBN4XTJGZQPXG1C","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:36.212Z","job_size_bytes":185,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-b0cdbc4bc4d49393e2086fa3: done: 1.490976 sec","job_status":"done","queue_duration_s":89.403579,"scheduling_latency_s":89.403603,"gitaly_calls":13,"gitaly_duration_s":0.317845,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.061214000000000005,"redis_read_bytes":2103,"redis_write_bytes":21751,"redis_cache_calls":15,"redis_cache_duration_s":0.006604,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.008488,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.001907,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7839,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.005113,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.022231,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.016871,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.089,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.334,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.394,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.089,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.020931,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00088104,"exclusive_lock_hold_duration_s":0.040834880000000004,"duration_s":1.490976,"completed_at":"2026-08-13T16:01:07.107Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.155742,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2099gitlab # [ 419.289705] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:07.111Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","c63bd0c49cf6bac627c947e375677c7c8d555c39 a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"5a4e2578d9d832a29cbc5b0a","created_at":"2026-08-13T15:59:41.376Z","trace_propagation_headers":{"sentry-trace":"1256f8b2f82e4d768e0c21f6b7ec996e-e796a750e2fe42cf","baggage":"sentry-trace_id=1256f8b2f82e4d768e0c21f6b7ec996e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXXKHAST32NPD9A1PGRMCDH","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:41.382Z","job_size_bytes":185,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-5a4e2578d9d832a29cbc5b0a: start","job_status":"start","queue_duration_s":85.728317,"scheduling_latency_s":85.728358}2100gitlab # [ 419.311376] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:07.133Z","message":"changes: \"c63bd0c49cf6bac627c947e375677c7c8d555c39 a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 refs/heads/master\\n\""}2101gitlab # [ 419.314494] gitaly[895]: time="2026-08-13T16:01:07.189Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZXXKHAST32NPD9A1PGRMCDH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T16:01:17.151" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T16:01:07.172" grpc.time_ms=16.952 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2102gitlab # [ 419.330648] nixbot[3524]: INFO: ::ffff:127.0.0.1:35902 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK2103gitlab # [ 419.332842] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:07.224Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"83b90161f1115d56b956b923","created_at":"2026-08-13T16:01:07.221Z","trace_propagation_headers":{"sentry-trace":"1256f8b2f82e4d768e0c21f6b7ec996e-9da1175746e1498f","baggage":"sentry-trace_id=1256f8b2f82e4d768e0c21f6b7ec996e,sentry-release=Unknown"},"correlation_id":"01KZXXKHAST32NPD9A1PGRMCDH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"47a2aa495f0783b4fb51b62f","job_size_bytes":46,"pid":3502,"job_status":"deduplicated","message":"ProjectCacheWorker JID-83b90161f1115d56b956b923: deduplicated: until executing","deduplication.type":"until executing"}2104gitlab # [ 419.348454] gitaly[895]: time="2026-08-13T16:01:07.215Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKHAST32NPD9A1PGRMCDH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-13T16:01:17.007" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T16:01:07.198" grpc.time_ms=17.243 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2105gitlab # [ 419.362001] gitaly[895]: time="2026-08-13T16:01:07.269Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXXKHAST32NPD9A1PGRMCDH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-13T16:01:17.061" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T16:01:07.252" grpc.time_ms=17.605 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2106gitlab # [ 419.385547] gitaly[895]: time="2026-08-13T16:01:07.299Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXXKHAST32NPD9A1PGRMCDH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-08-13T16:01:37.178" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T16:01:07.279" grpc.time_ms=19.851 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2107gitlab # [ 419.418219] gitaly[895]: time="2026-08-13T16:01:07.331Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=318 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXXKHAST32NPD9A1PGRMCDH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-13T16:01:17.129" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-08-13T16:01:07.320" grpc.time_ms=11.398 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2108gitlab # [ 419.453645] gitaly[895]: time="2026-08-13T16:01:07.367Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXXKHAST32NPD9A1PGRMCDH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T16:01:17.159" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T16:01:07.349" grpc.time_ms=17.222 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2109gitlab # [ 419.625253] gitaly[895]: time="2026-08-13T16:01:07.538Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXXKHAST32NPD9A1PGRMCDH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-13T16:01:17.005" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T16:01:07.536" grpc.time_ms=2.376 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2110gitlab # [ 419.664735] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:07.573Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","c63bd0c49cf6bac627c947e375677c7c8d555c39 a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"5a4e2578d9d832a29cbc5b0a","created_at":"2026-08-13T15:59:41.376Z","trace_propagation_headers":{"sentry-trace":"1256f8b2f82e4d768e0c21f6b7ec996e-e796a750e2fe42cf","baggage":"sentry-trace_id=1256f8b2f82e4d768e0c21f6b7ec996e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXXKHAST32NPD9A1PGRMCDH","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-13T15:59:41.382Z","job_size_bytes":185,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-5a4e2578d9d832a29cbc5b0a: done: 0.462356 sec","job_status":"done","queue_duration_s":85.728317,"scheduling_latency_s":85.728358,"gitaly_calls":7,"gitaly_duration_s":0.13603,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.038194,"redis_read_bytes":500,"redis_write_bytes":11944,"redis_cache_calls":9,"redis_cache_duration_s":0.004517,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001606,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5721,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.006218,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.012201,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.013652,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.042,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.044,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.044,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.042,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.281507,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00148866,"exclusive_lock_hold_duration_s":0.03525782,"duration_s":0.462356,"completed_at":"2026-08-13T16:01:07.573Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.044291,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2111gitlab # [ 419.760407] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:07.576Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"75d5c6af32599ce54573c44a","created_at":"2026-08-13T15:59:42.024Z","trace_propagation_headers":{"sentry-trace":"08f69b47d8b249c6b8e09966020c6790-d67203ca99cb4569","baggage":"sentry-trace_id=08f69b47d8b249c6b8e09966020c6790,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXXKHYBQV6GSR1GY1CC9BRA","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:42.050Z","job_size_bytes":65,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-75d5c6af32599ce54573c44a: start","job_status":"start","queue_duration_s":85.525806,"scheduling_latency_s":85.525842}2112gitlab # [ 419.840522] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:07.752Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"75d5c6af32599ce54573c44a","created_at":"2026-08-13T15:59:42.024Z","trace_propagation_headers":{"sentry-trace":"08f69b47d8b249c6b8e09966020c6790-d67203ca99cb4569","baggage":"sentry-trace_id=08f69b47d8b249c6b8e09966020c6790,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXXKHYBQV6GSR1GY1CC9BRA","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:42.050Z","job_size_bytes":65,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-75d5c6af32599ce54573c44a: done: 0.176748 sec","job_status":"done","queue_duration_s":85.525806,"scheduling_latency_s":85.525842,"redis_calls":16,"redis_duration_s":0.007376000000000001,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.003584,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002416,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001376,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.126161,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00097144,"duration_s":0.176748,"completed_at":"2026-08-13T16:01:07.752Z","load_balancing_strategy":"primary","db_duration_s":0.038154,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2113gitlab # [ 419.932204] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:07.756Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"521e5ba1c68835e923ab537f","created_at":"2026-08-13T15:59:42.052Z","trace_propagation_headers":{"sentry-trace":"08f69b47d8b249c6b8e09966020c6790-d67203ca99cb4569","baggage":"sentry-trace_id=08f69b47d8b249c6b8e09966020c6790,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXXKHYBQV6GSR1GY1CC9BRA","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:42.064Z","job_size_bytes":65,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-521e5ba1c68835e923ab537f: start","job_status":"start","queue_duration_s":85.691486,"scheduling_latency_s":85.691527}2114gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'2115gitlab # [ 420.161109] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:08.074Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"521e5ba1c68835e923ab537f","created_at":"2026-08-13T15:59:42.052Z","trace_propagation_headers":{"sentry-trace":"08f69b47d8b249c6b8e09966020c6790-d67203ca99cb4569","baggage":"sentry-trace_id=08f69b47d8b249c6b8e09966020c6790,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXXKHYBQV6GSR1GY1CC9BRA","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:42.064Z","job_size_bytes":65,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-521e5ba1c68835e923ab537f: done: 0.317909 sec","job_status":"done","queue_duration_s":85.691486,"scheduling_latency_s":85.691527,"redis_calls":21,"redis_duration_s":0.007653,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.003855,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001994,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001804,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.045,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.033,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.250682,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00054288,"duration_s":0.317909,"completed_at":"2026-08-13T16:01:08.074Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.053663,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2116gitlab # [ 420.261811] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:08.076Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"45867b0a226488ee94f36305","created_at":"2026-08-13T15:59:42.272Z","trace_propagation_headers":{"sentry-trace":"08f69b47d8b249c6b8e09966020c6790-d67203ca99cb4569","baggage":"sentry-trace_id=08f69b47d8b249c6b8e09966020c6790,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXXKHYBQV6GSR1GY1CC9BRA","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:42.280Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-45867b0a226488ee94f36305: start","job_status":"start","queue_duration_s":85.795743,"scheduling_latency_s":85.795769}2117gitlab # [ 420.315048] nixbot[3524]: INFO: ::ffff:127.0.0.1:35904 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK2118gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.08 seconds)2119gitlab # [ 420.456819] gitaly[895]: time="2026-08-13T16:01:08.369Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXXKHYBQV6GSR1GY1CC9BRA grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T16:01:08.367" grpc.time_ms=1.593 pid=895 span.kind=server system=grpc2120gitlab # [ 420.508778] gitaly[895]: time="2026-08-13T16:01:08.422Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXXKHYBQV6GSR1GY1CC9BRA grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3895 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T16:01:08.421" grpc.time_ms=0.868 pid=895 span.kind=server system=grpc2121gitlab # [ 420.560479] gitaly[895]: time="2026-08-13T16:01:08.473Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXXKHYBQV6GSR1GY1CC9BRA grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T16:01:08.473" grpc.time_ms=0.783 pid=895 span.kind=server system=grpc2122gitlab # [ 420.589674] gitaly[895]: time="2026-08-13T16:01:08.487Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKHYBQV6GSR1GY1CC9BRA diskcache=536650fc-ad22-4ecb-a026-00159f46b02f grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-13T16:01:38.210" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-13T16:01:08.311" pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2123gitlab # [ 420.611265] gitaly[895]: time="2026-08-13T16:01:08.487Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=195 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7366 command.oublock=0 command.real_time_ms=168 command.spawn_token_fork_ms=1 command.system_time_ms=104 command.user_time_ms=91 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKHYBQV6GSR1GY1CC9BRA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-13T16:01:38.210" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T16:01:08.311" grpc.time_ms=176.4 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2124gitlab # [ 420.772893] gitaly[895]: time="2026-08-13T16:01:08.686Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXXKHYBQV6GSR1GY1CC9BRA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-13T16:01:38.584" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T16:01:08.685" grpc.time_ms=1.382 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2125gitlab # [ 420.829465] gitaly[895]: time="2026-08-13T16:01:08.742Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKHYBQV6GSR1GY1CC9BRA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T16:01:38.640" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T16:01:08.741" grpc.time_ms=1.092 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2126gitlab # [ 420.865169] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:08.768Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"45867b0a226488ee94f36305","created_at":"2026-08-13T15:59:42.272Z","trace_propagation_headers":{"sentry-trace":"08f69b47d8b249c6b8e09966020c6790-d67203ca99cb4569","baggage":"sentry-trace_id=08f69b47d8b249c6b8e09966020c6790,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXXKHYBQV6GSR1GY1CC9BRA","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-13T15:59:42.280Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-45867b0a226488ee94f36305: done: 0.69227 sec","job_status":"done","queue_duration_s":85.795743,"scheduling_latency_s":85.795769,"gitaly_calls":3,"gitaly_duration_s":0.190729,"redis_calls":117,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.039038,"redis_read_bytes":457,"redis_write_bytes":27998,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.00197,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001869,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.014845,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":25,"redis_queues_duration_s":0.005647,"redis_queues_read_bytes":36,"redis_queues_write_bytes":14492,"redis_queues_metadata_calls":21,"redis_queues_metadata_duration_s":0.007647,"redis_queues_metadata_read_bytes":32,"redis_queues_metadata_write_bytes":3370,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.001194,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000954,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002942,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.101,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.041,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.046,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.046,"db_ci_duration_s":0.055,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.372661,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.61626596,"duration_s":0.69227,"completed_at":"2026-08-13T16:01:08.768Z","load_balancing_strategy":"primary","db_duration_s":0.116594,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2127gitlab # [ 420.944066] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:08.770Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"47a2aa495f0783b4fb51b62f","created_at":"2026-08-13T16:01:05.714Z","trace_propagation_headers":{"sentry-trace":"b0f29b1d8e2f4f118927dcd642e1b365-989dab0396934eff","baggage":"sentry-trace_id=b0f29b1d8e2f4f118927dcd642e1b365,sentry-release=Unknown"},"correlation_id":"01KZXXKB9SRRBN4XTJGZQPXG1C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:05.737Z","job_size_bytes":46,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-47a2aa495f0783b4fb51b62f: start","job_status":"start","queue_duration_s":3.033117,"scheduling_latency_s":3.033144}2128gitlab # [ 420.961557] gitaly[895]: time="2026-08-13T16:01:08.837Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKB9SRRBN4XTJGZQPXG1C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-08-13T22:01:08.825" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T16:01:08.825" grpc.time_ms=10.437 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2129gitlab # [ 420.973549] gitaly[895]: time="2026-08-13T16:01:08.864Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=597 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKB9SRRBN4XTJGZQPXG1C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-13T16:01:38.745" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T16:01:08.846" grpc.time_ms=17.524 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2130gitlab # [ 420.987920] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:08.896Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"47a2aa495f0783b4fb51b62f","created_at":"2026-08-13T16:01:05.714Z","trace_propagation_headers":{"sentry-trace":"b0f29b1d8e2f4f118927dcd642e1b365-989dab0396934eff","baggage":"sentry-trace_id=b0f29b1d8e2f4f118927dcd642e1b365,sentry-release=Unknown"},"correlation_id":"01KZXXKB9SRRBN4XTJGZQPXG1C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:05.737Z","job_size_bytes":46,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-47a2aa495f0783b4fb51b62f: done: 0.125611 sec","job_status":"done","queue_duration_s":3.033117,"scheduling_latency_s":3.033144,"gitaly_calls":2,"gitaly_duration_s":0.034142,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.008045,"redis_read_bytes":69,"redis_write_bytes":4888,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001514,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000614,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2116,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001874,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.003236,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000807,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.068915,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003531,"duration_s":0.125611,"completed_at":"2026-08-13T16:01:08.896Z","load_balancing_strategy":"primary","db_duration_s":0.015761,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2131gitlab # [ 421.038000] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:08.898Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"c60481429c47faf83fbdb4d4","created_at":"2026-08-13T16:01:05.760Z","trace_propagation_headers":{"sentry-trace":"b0f29b1d8e2f4f118927dcd642e1b365-989dab0396934eff","baggage":"sentry-trace_id=b0f29b1d8e2f4f118927dcd642e1b365,sentry-release=Unknown"},"correlation_id":"01KZXXKB9SRRBN4XTJGZQPXG1C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:05.766Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-c60481429c47faf83fbdb4d4: start","job_status":"start","queue_duration_s":3.131534,"scheduling_latency_s":3.131559}2132gitlab # [ 421.055147] gitaly[895]: time="2026-08-13T16:01:08.956Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKB9SRRBN4XTJGZQPXG1C diskcache=c1bde6fa-1704-4913-975e-fa075a802021 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-13T22:01:08.924" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T16:01:08.924" pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2133gitlab # [ 421.065245] gitaly[895]: time="2026-08-13T16:01:08.957Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=21 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1174 command.oublock=0 command.real_time_ms=34 command.spawn_token_fork_ms=4 command.system_time_ms=14 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKB9SRRBN4XTJGZQPXG1C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-13T22:01:08.924" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T16:01:08.924" grpc.time_ms=32.306 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2134gitlab # [ 421.092172] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:09.005Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"c60481429c47faf83fbdb4d4","created_at":"2026-08-13T16:01:05.760Z","trace_propagation_headers":{"sentry-trace":"b0f29b1d8e2f4f118927dcd642e1b365-989dab0396934eff","baggage":"sentry-trace_id=b0f29b1d8e2f4f118927dcd642e1b365,sentry-release=Unknown"},"correlation_id":"01KZXXKB9SRRBN4XTJGZQPXG1C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:05.766Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-c60481429c47faf83fbdb4d4: done: 0.107294 sec","job_status":"done","queue_duration_s":3.131534,"scheduling_latency_s":3.131559,"gitaly_calls":1,"gitaly_duration_s":0.035084,"redis_calls":15,"redis_duration_s":0.003984,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000446,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001557,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000682,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001299,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.015,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.026,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043422,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.07935004,"duration_s":0.107294,"completed_at":"2026-08-13T16:01:09.005Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.021566,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2135gitlab # [ 421.139274] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:09.006Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"db66976ab09b7e90bdb54364","created_at":"2026-08-13T16:01:05.913Z","trace_propagation_headers":{"sentry-trace":"b0f29b1d8e2f4f118927dcd642e1b365-989dab0396934eff","baggage":"sentry-trace_id=b0f29b1d8e2f4f118927dcd642e1b365,sentry-release=Unknown"},"correlation_id":"01KZXXKB9SRRBN4XTJGZQPXG1C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:05.916Z","job_size_bytes":23,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-db66976ab09b7e90bdb54364: start","job_status":"start","queue_duration_s":3.090637,"scheduling_latency_s":3.090655}2136gitlab # [ 421.155655] gitaly[895]: time="2026-08-13T16:01:09.055Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=10 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKB9SRRBN4XTJGZQPXG1C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-13T16:01:39.037" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T16:01:09.037" grpc.time_ms=17.767 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2137gitlab # [ 421.169209] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:09.075Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"db66976ab09b7e90bdb54364","created_at":"2026-08-13T16:01:05.913Z","trace_propagation_headers":{"sentry-trace":"b0f29b1d8e2f4f118927dcd642e1b365-989dab0396934eff","baggage":"sentry-trace_id=b0f29b1d8e2f4f118927dcd642e1b365,sentry-release=Unknown"},"correlation_id":"01KZXXKB9SRRBN4XTJGZQPXG1C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:05.916Z","job_size_bytes":23,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-db66976ab09b7e90bdb54364: done: 0.068354 sec","job_status":"done","queue_duration_s":3.090637,"scheduling_latency_s":3.090655,"gitaly_calls":1,"gitaly_duration_s":0.020383,"redis_calls":16,"redis_duration_s":0.004926,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.00045,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001459,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.002099,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000918,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037025,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.068354,"completed_at":"2026-08-13T16:01:09.075Z","load_balancing_strategy":"primary","db_duration_s":0.004277,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2138gitlab # [ 421.215118] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:09.079Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"14a888d23092338e684c772b","created_at":"2026-08-13T16:01:06.787Z","trace_propagation_headers":{"sentry-trace":"b0f29b1d8e2f4f118927dcd642e1b365-989dab0396934eff","baggage":"sentry-trace_id=b0f29b1d8e2f4f118927dcd642e1b365,sentry-release=Unknown"},"correlation_id":"01KZXXKB9SRRBN4XTJGZQPXG1C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e25248230ef668495832374dbfbd01bc8e56f0e37fa3b06ef9930082fe51fe7a","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:06.798Z","job_size_bytes":467,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-14a888d23092338e684c772b: start","job_status":"start","queue_duration_s":2.281379,"scheduling_latency_s":2.281425}2139gitlab # [ 421.232657] gitaly[895]: time="2026-08-13T16:01:09.133Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKB9SRRBN4XTJGZQPXG1C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T16:01:39.131" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T16:01:09.131" grpc.time_ms=1.075 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2140gitlab # [ 421.245144] gitaly[895]: time="2026-08-13T16:01:09.154Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKB9SRRBN4XTJGZQPXG1C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-13T16:01:19.116" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T16:01:09.137" grpc.time_ms=17.185 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2141gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'2142gitlab # [ 421.373835] nixbot[3524]: INFO: ::ffff:127.0.0.1:57672 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK2143gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.06 seconds)2144gitlab # [ 421.451502] gitaly[895]: time="2026-08-13T16:01:09.365Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXXKB9SRRBN4XTJGZQPXG1C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-13T16:01:39.362" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T16:01:09.362" grpc.time_ms=1.795 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2145gitlab # [ 421.491013] gitaly[895]: time="2026-08-13T16:01:09.375Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=47 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXXKB9SRRBN4XTJGZQPXG1C error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-13T16:01:39.370" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T16:01:09.370" grpc.time_ms=4.848 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2146gitlab # [ 421.603242] gitaly[895]: time="2026-08-13T16:01:09.516Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXXKB9SRRBN4XTJGZQPXG1C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T16:01:19.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T16:01:09.498" grpc.time_ms=17.651 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2147gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'2148gitlab # [ 422.376941] gitaly[895]: time="2026-08-13T16:01:10.290Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=881 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=2 command.system_time_ms=17 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZXXKB9SRRBN4XTJGZQPXG1C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-13T16:01:40.262" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T16:01:10.262" grpc.time_ms=27.769 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2149gitlab # [ 422.427050] nixbot[3524]: INFO: ::ffff:127.0.0.1:57682 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK2150gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.05 seconds)2151gitlab # [ 422.433806] gitaly[895]: time="2026-08-13T16:01:10.347Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=3 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01KZXXKB9SRRBN4XTJGZQPXG1C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-13T16:01:40.325" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T16:01:10.325" grpc.time_ms=21.667 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2152gitlab # [ 422.496519] sidekiq-cluster[3502]: {"severity":"WARN","time":"2026-08-13T16:01:10.408Z","class":"CreatePipelineWorker","correlation_id":"01KZXXKB9SRRBN4XTJGZQPXG1C","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"c63bd0c49cf6bac627c947e375677c7c8d555c39","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"c63bd0c49cf6bac627c947e375677c7c8d555c39","ref":"refs/heads/master"},"retry":0}2153gitlab # [ 422.515097] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:10.423Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"14a888d23092338e684c772b","created_at":"2026-08-13T16:01:06.787Z","trace_propagation_headers":{"sentry-trace":"b0f29b1d8e2f4f118927dcd642e1b365-989dab0396934eff","baggage":"sentry-trace_id=b0f29b1d8e2f4f118927dcd642e1b365,sentry-release=Unknown"},"correlation_id":"01KZXXKB9SRRBN4XTJGZQPXG1C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e25248230ef668495832374dbfbd01bc8e56f0e37fa3b06ef9930082fe51fe7a","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:06.798Z","job_size_bytes":467,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-14a888d23092338e684c772b: done: 1.344107 sec","job_status":"done","queue_duration_s":2.281379,"scheduling_latency_s":2.281425,"gitaly_calls":7,"gitaly_duration_s":0.147791,"redis_calls":51,"redis_duration_s":0.014974,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.001377,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.006523,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001909,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003613,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001552,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.048,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.041,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.111287,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00057694,"duration_s":1.344107,"completed_at":"2026-08-13T16:01:10.423Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.087197,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2154gitlab # [ 422.590902] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:10.426Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"295f992f-6d27-4fc0-8bdc-784f188595d7\"}"],"class":"WebHookWorker","jid":"df02c56d6438114257845947","created_at":"2026-08-13T16:01:06.987Z","trace_propagation_headers":{"sentry-trace":"b0f29b1d8e2f4f118927dcd642e1b365-989dab0396934eff","baggage":"sentry-trace_id=b0f29b1d8e2f4f118927dcd642e1b365,sentry-release=Unknown"},"correlation_id":"01KZXXKB9SRRBN4XTJGZQPXG1C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:81bc4aeb26d0808ace8a77675769b5f5fa490f44a6081de39f87c8d55e5b0614","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:06.994Z","job_size_bytes":1751,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-df02c56d6438114257845947: start","job_status":"start","queue_duration_s":3.431976,"scheduling_latency_s":3.432013}2155gitlab # [ 422.755870] nixbot[3524]: INFO: ::ffff:127.0.0.1:57686 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2156gitlab # [ 422.800507] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:10.712Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"295f992f-6d27-4fc0-8bdc-784f188595d7\"}"],"class":"WebHookWorker","jid":"df02c56d6438114257845947","created_at":"2026-08-13T16:01:06.987Z","trace_propagation_headers":{"sentry-trace":"b0f29b1d8e2f4f118927dcd642e1b365-989dab0396934eff","baggage":"sentry-trace_id=b0f29b1d8e2f4f118927dcd642e1b365,sentry-release=Unknown"},"correlation_id":"01KZXXKB9SRRBN4XTJGZQPXG1C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:81bc4aeb26d0808ace8a77675769b5f5fa490f44a6081de39f87c8d55e5b0614","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:06.994Z","job_size_bytes":1751,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-df02c56d6438114257845947: done: 0.286145 sec","job_status":"done","queue_duration_s":3.431976,"scheduling_latency_s":3.432013,"redis_calls":19,"redis_duration_s":0.007078,"redis_read_bytes":32,"redis_write_bytes":5365,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001754,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000685,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3727,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002974,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001665,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.09099794000002248,"cpu_s":0.170031,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00083156,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.286145,"completed_at":"2026-08-13T16:01:10.712Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005326,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2157gitlab # [ 422.913851] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:10.716Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"b5e2526bdd6b07986bc4359c","created_at":"2026-08-13T16:01:07.238Z","trace_propagation_headers":{"sentry-trace":"1256f8b2f82e4d768e0c21f6b7ec996e-9da1175746e1498f","baggage":"sentry-trace_id=1256f8b2f82e4d768e0c21f6b7ec996e,sentry-release=Unknown"},"correlation_id":"01KZXXKHAST32NPD9A1PGRMCDH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"c60481429c47faf83fbdb4d4","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:07.243Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-b5e2526bdd6b07986bc4359c: start","job_status":"start","queue_duration_s":3.472849,"scheduling_latency_s":3.472902}2158gitlab # [ 422.945517] gitaly[895]: time="2026-08-13T16:01:10.823Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKHAST32NPD9A1PGRMCDH diskcache=eb4b35dc-8ee7-4bb9-9a35-fa4affcd83b6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-13T22:01:10.760" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T16:01:10.761" pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2159gitlab # [ 422.958849] gitaly[895]: time="2026-08-13T16:01:10.824Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=290 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKHAST32NPD9A1PGRMCDH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-13T22:01:10.760" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T16:01:10.761" grpc.time_ms=62.669 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2160gitlab # [ 422.974676] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:10.859Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"b5e2526bdd6b07986bc4359c","created_at":"2026-08-13T16:01:07.238Z","trace_propagation_headers":{"sentry-trace":"1256f8b2f82e4d768e0c21f6b7ec996e-9da1175746e1498f","baggage":"sentry-trace_id=1256f8b2f82e4d768e0c21f6b7ec996e,sentry-release=Unknown"},"correlation_id":"01KZXXKHAST32NPD9A1PGRMCDH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"c60481429c47faf83fbdb4d4","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:07.243Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-b5e2526bdd6b07986bc4359c: done: 0.14268 sec","job_status":"done","queue_duration_s":3.472849,"scheduling_latency_s":3.472902,"gitaly_calls":1,"gitaly_duration_s":0.067011,"redis_calls":12,"redis_duration_s":0.007916,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003269,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.002582,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002065,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.012,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.012,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055028,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.1000433,"duration_s":0.14268,"completed_at":"2026-08-13T16:01:10.859Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011317,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2161gitlab # [ 423.023878] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:10.862Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"31dba9564204ee8eb132e3a3","created_at":"2026-08-13T16:01:07.475Z","trace_propagation_headers":{"sentry-trace":"1256f8b2f82e4d768e0c21f6b7ec996e-9da1175746e1498f","baggage":"sentry-trace_id=1256f8b2f82e4d768e0c21f6b7ec996e,sentry-release=Unknown"},"correlation_id":"01KZXXKHAST32NPD9A1PGRMCDH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0f26f2459c82b017ea5427213d934edc3d4c387efb9f220d14ae794517cbbe73","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:07.480Z","job_size_bytes":467,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-31dba9564204ee8eb132e3a3: start","job_status":"start","queue_duration_s":3.381344,"scheduling_latency_s":3.381378}2162gitlab # [ 423.042544] gitaly[895]: time="2026-08-13T16:01:10.900Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKHAST32NPD9A1PGRMCDH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T16:01:40.898" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T16:01:10.899" grpc.time_ms=0.937 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2163gitlab # [ 423.055731] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:16:01:10 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1832164gitlab # [ 423.058005] gitaly[895]: time="2026-08-13T16:01:10.902Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZXXP920FAX37VD7X644Y7R3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T16:01:10.883" grpc.time_ms=19.41 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc2165gitlab # [ 423.071242] gitaly[895]: time="2026-08-13T16:01:10.930Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXKHAST32NPD9A1PGRMCDH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-13T16:01:20.004" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T16:01:10.905" grpc.time_ms=25.618 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2166gitlab # [ 423.084425] gitaly[895]: time="2026-08-13T16:01:10.995Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXXKHAST32NPD9A1PGRMCDH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-13T16:01:40.093" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T16:01:10.994" grpc.time_ms=1.412 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2167gitlab # [ 423.098434] gitaly[895]: time="2026-08-13T16:01:11.012Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=3 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=3 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=158 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXXKHAST32NPD9A1PGRMCDH error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-13T16:01:41.003" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T16:01:11.004" grpc.time_ms=6.955 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2168gitlab # [ 423.127060] gitaly[895]: time="2026-08-13T16:01:11.040Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZXXP97T0ZXYVYR7VETNHR1F grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T16:01:11.021" pid=895 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2169gitlab # [ 423.137629] gitaly[895]: time="2026-08-13T16:01:11.040Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=6 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXP97T0ZXYVYR7VETNHR1F grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T16:01:11.021" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc2170gitlab # [ 423.151124] gitlab-workhorse[821]: time="2026-08-13T16:01:11Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672171gitlab # [ 423.153050] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:16:01:11 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1352172gitlab # [ 423.154920] gitaly[895]: time="2026-08-13T16:01:11.041Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=6 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXP97T0ZXYVYR7VETNHR1F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T16:01:11.021" grpc.time_ms=19.799 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc2173gitlab # [ 423.174578] gitaly[895]: time="2026-08-13T16:01:11.088Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=3 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXXKHAST32NPD9A1PGRMCDH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T16:01:21.011" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T16:01:11.071" grpc.time_ms=16.464 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2174gitlab # [ 423.187916] nixbot[3524]: {"ts": "2026-08-13T16:01:11.099Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}2175gitlab # [ 423.337840] gitaly[895]: time="2026-08-13T16:01:11.251Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXP9EE1A600KHAZWRTCTJM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T16:01:41.148" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T16:01:11.249" grpc.time_ms=1.293 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2176gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'2177gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.07 seconds)2178gitlab # [ 423.496879] gitaly[895]: time="2026-08-13T16:01:11.410Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=4 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXXP9EE1A600KHAZWRTCTJM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T16:01:21.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T16:01:11.394" grpc.time_ms=15.923 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2179gitlab # [ 423.536459] nixbot[3524]: INFO: ::ffff:127.0.0.1:57690 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK2180gitlab # [ 423.637854] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:16:01:11 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/c63bd0c49cf6bac627c947e375677c7c8d555c39 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 4322181gitlab # [ 423.646008] nixbot[3524]: {"ts": "2026-08-13T16:01:11.552Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/c63bd0c49cf6bac627c947e375677c7c8d555c39 \"HTTP/1.1 201 Created\""}2182gitlab # [ 423.739630] gitaly[895]: time="2026-08-13T16:01:11.653Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXP9W5ZKMWKGCHTCYDXNZB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T16:01:41.550" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T16:01:11.651" grpc.time_ms=1.248 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2183gitlab # [ 423.830704] gitaly[895]: time="2026-08-13T16:01:11.744Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXXP9W5ZKMWKGCHTCYDXNZB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T16:01:21.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T16:01:11.726" grpc.time_ms=17.184 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2184gitlab # [ 423.903342] gitaly[895]: time="2026-08-13T16:01:11.816Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=882 command.oublock=0 command.real_time_ms=22 command.spawn_token_fork_ms=1 command.system_time_ms=16 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZXXKHAST32NPD9A1PGRMCDH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-13T16:01:41.790" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T16:01:11.790" grpc.time_ms=25.683 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2185gitlab # [ 423.944543] gitaly[895]: time="2026-08-13T16:01:11.844Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXXKHAST32NPD9A1PGRMCDH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-13T16:01:41.819" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T16:01:11.819" grpc.time_ms=24.598 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2186gitlab # [ 423.979373] nixbot[3524]: {"ts": "2026-08-13T16:01:11.851Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/c63bd0c49cf6bac627c947e375677c7c8d555c39 \"HTTP/1.1 201 Created\""}2187gitlab # [ 423.985574] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:16:01:11 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/c63bd0c49cf6bac627c947e375677c7c8d555c39 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2922188gitlab # [ 423.991053] sidekiq-cluster[3502]: {"severity":"WARN","time":"2026-08-13T16:01:11.862Z","class":"CreatePipelineWorker","correlation_id":"01KZXXKHAST32NPD9A1PGRMCDH","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"c63bd0c49cf6bac627c947e375677c7c8d555c39","after":"a19390f81ad0b5cd0bb453a70a8d42e2f9922b04","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"a19390f81ad0b5cd0bb453a70a8d42e2f9922b04","ref":"refs/heads/master"},"retry":0}2189gitlab # [ 424.003279] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:11.872Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"31dba9564204ee8eb132e3a3","created_at":"2026-08-13T16:01:07.475Z","trace_propagation_headers":{"sentry-trace":"1256f8b2f82e4d768e0c21f6b7ec996e-9da1175746e1498f","baggage":"sentry-trace_id=1256f8b2f82e4d768e0c21f6b7ec996e,sentry-release=Unknown"},"correlation_id":"01KZXXKHAST32NPD9A1PGRMCDH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0f26f2459c82b017ea5427213d934edc3d4c387efb9f220d14ae794517cbbe73","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:07.480Z","job_size_bytes":467,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-31dba9564204ee8eb132e3a3: done: 1.010151 sec","job_status":"done","queue_duration_s":3.381344,"scheduling_latency_s":3.381378,"gitaly_calls":7,"gitaly_duration_s":0.129945,"redis_calls":33,"redis_duration_s":0.010756,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.001351,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001486,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.006564,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001355,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.037,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.031,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.848544,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":1.010151,"completed_at":"2026-08-13T16:01:11.872Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.036876,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2190gitlab # [ 424.072860] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:11.875Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"1561a426-6ed5-4721-8ea8-116f764c5af7\"}"],"class":"WebHookWorker","jid":"bf94ce8099cda47a685657e3","created_at":"2026-08-13T16:01:07.509Z","trace_propagation_headers":{"sentry-trace":"1256f8b2f82e4d768e0c21f6b7ec996e-9da1175746e1498f","baggage":"sentry-trace_id=1256f8b2f82e4d768e0c21f6b7ec996e,sentry-release=Unknown"},"correlation_id":"01KZXXKHAST32NPD9A1PGRMCDH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:68201ac721f785f5491091a9b043a423938147f3197e2ab2cb73fc4e0f29686e","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:07.513Z","job_size_bytes":1749,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-bf94ce8099cda47a685657e3: start","job_status":"start","queue_duration_s":4.361056,"scheduling_latency_s":4.361091}2191gitlab # [ 424.092916] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:11.944Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"1561a426-6ed5-4721-8ea8-116f764c5af7\"}"],"class":"WebHookWorker","jid":"bf94ce8099cda47a685657e3","created_at":"2026-08-13T16:01:07.509Z","trace_propagation_headers":{"sentry-trace":"1256f8b2f82e4d768e0c21f6b7ec996e-9da1175746e1498f","baggage":"sentry-trace_id=1256f8b2f82e4d768e0c21f6b7ec996e,sentry-release=Unknown"},"correlation_id":"01KZXXKHAST32NPD9A1PGRMCDH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:68201ac721f785f5491091a9b043a423938147f3197e2ab2cb73fc4e0f29686e","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:07.513Z","job_size_bytes":1749,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-bf94ce8099cda47a685657e3: done: 0.069139 sec","job_status":"done","queue_duration_s":4.361056,"scheduling_latency_s":4.361091,"redis_calls":14,"redis_duration_s":0.004561,"redis_read_bytes":26,"redis_write_bytes":4682,"redis_queues_calls":2,"redis_queues_duration_s":0.000568,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3726,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002697,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001296,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.011470640000027288,"cpu_s":0.043967,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.069139,"completed_at":"2026-08-13T16:01:11.943Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002901,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2192gitlab # [ 424.140841] gitaly[895]: time="2026-08-13T16:01:11.940Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXPA5NME6DSDF7BP0015YN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T16:01:41.838" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T16:01:11.938" grpc.time_ms=1.14 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2193gitlab # [ 424.155132] nixbot[3524]: INFO: ::ffff:127.0.0.1:57692 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2194gitlab # [ 424.156786] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:11.948Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"99e0fdd38f50a88470d6f878","created_at":"2026-08-13T16:01:08.275Z","trace_propagation_headers":{"sentry-trace":"08f69b47d8b249c6b8e09966020c6790-f7235fc7d04e4876","baggage":"sentry-trace_id=08f69b47d8b249c6b8e09966020c6790,sentry-release=Unknown"},"correlation_id":"01KZXXKHYBQV6GSR1GY1CC9BRA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:08.286Z","job_size_bytes":23,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-99e0fdd38f50a88470d6f878: start","job_status":"start","queue_duration_s":3.661313,"scheduling_latency_s":3.661347}2195gitlab # [ 424.176157] gitaly[895]: time="2026-08-13T16:01:12.009Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=7 command.system_time_ms=0 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01KZXXPA5NME6DSDF7BP0015YN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T16:01:21.278" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T16:01:11.999" grpc.time_ms=10.079 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2196gitlab # [ 424.191526] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:16:01:12 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 782197gitlab # [ 424.193948] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:16:01:12 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/c63bd0c49cf6bac627c947e375677c7c8d555c39 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2192198gitlab # [ 424.196601] nixbot[3524]: {"ts": "2026-08-13T16:01:12.083Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/c63bd0c49cf6bac627c947e375677c7c8d555c39 \"HTTP/1.1 201 Created\""}2199gitlab # [ 424.199363] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:12.083Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"99e0fdd38f50a88470d6f878","created_at":"2026-08-13T16:01:08.275Z","trace_propagation_headers":{"sentry-trace":"08f69b47d8b249c6b8e09966020c6790-f7235fc7d04e4876","baggage":"sentry-trace_id=08f69b47d8b249c6b8e09966020c6790,sentry-release=Unknown"},"correlation_id":"01KZXXKHYBQV6GSR1GY1CC9BRA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:08.286Z","job_size_bytes":23,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-99e0fdd38f50a88470d6f878: done: 0.135553 sec","job_status":"done","queue_duration_s":3.661313,"scheduling_latency_s":3.661347,"redis_calls":10,"redis_duration_s":0.006117,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000651,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002982,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002484,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.100402,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0005166,"duration_s":0.135553,"completed_at":"2026-08-13T16:01:12.083Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.022329,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2200gitlab # [ 424.246669] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:12.090Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"85ddb571e1844ac4bc5137aa","created_at":"2026-08-13T16:01:08.499Z","trace_propagation_headers":{"sentry-trace":"08f69b47d8b249c6b8e09966020c6790-f7235fc7d04e4876","baggage":"sentry-trace_id=08f69b47d8b249c6b8e09966020c6790,sentry-release=Unknown"},"correlation_id":"01KZXXKHYBQV6GSR1GY1CC9BRA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:08.511Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-85ddb571e1844ac4bc5137aa: start","job_status":"start","queue_duration_s":3.578976,"scheduling_latency_s":3.579011}2201gitlab # [ 424.264055] gitaly[895]: time="2026-08-13T16:01:12.054Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01KZXXPA98CS04TE49AJQVZNG3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T16:01:12.046" grpc.time_ms=8.203 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc2202gitlab # [ 424.277591] gitaly[895]: time="2026-08-13T16:01:12.130Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZXXPABR71VF08G0KQ3Y0CGB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T16:01:12.120" pid=895 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2203gitlab # [ 424.288171] gitlab-workhorse[821]: time="2026-08-13T16:01:12Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672204gitlab # [ 424.290039] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:16:01:12 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 742205gitlab # [ 424.291950] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:12.137Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"85ddb571e1844ac4bc5137aa","created_at":"2026-08-13T16:01:08.499Z","trace_propagation_headers":{"sentry-trace":"08f69b47d8b249c6b8e09966020c6790-f7235fc7d04e4876","baggage":"sentry-trace_id=08f69b47d8b249c6b8e09966020c6790,sentry-release=Unknown"},"correlation_id":"01KZXXKHYBQV6GSR1GY1CC9BRA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:08.511Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-85ddb571e1844ac4bc5137aa: done: 0.047185 sec","job_status":"done","queue_duration_s":3.578976,"scheduling_latency_s":3.579011,"redis_calls":10,"redis_duration_s":0.003951,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001568,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001414,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000969,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031653,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034758,"duration_s":0.047185,"completed_at":"2026-08-13T16:01:12.137Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005485,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2206gitlab # [ 424.337389] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:12.139Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"dc950af973e22aa0ea2ff7fa","created_at":"2026-08-13T16:01:08.543Z","trace_propagation_headers":{"sentry-trace":"08f69b47d8b249c6b8e09966020c6790-f7235fc7d04e4876","baggage":"sentry-trace_id=08f69b47d8b249c6b8e09966020c6790,sentry-release=Unknown"},"correlation_id":"01KZXXKHYBQV6GSR1GY1CC9BRA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:08.554Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-dc950af973e22aa0ea2ff7fa: start","job_status":"start","queue_duration_s":3.584487,"scheduling_latency_s":3.584506}2207gitlab # [ 424.353595] gitaly[895]: time="2026-08-13T16:01:12.130Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXPABR71VF08G0KQ3Y0CGB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T16:01:12.120" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc2208gitlab # [ 424.367119] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:16:01:12 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 732209gitlab # [ 424.369361] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:12.185Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"dc950af973e22aa0ea2ff7fa","created_at":"2026-08-13T16:01:08.543Z","trace_propagation_headers":{"sentry-trace":"08f69b47d8b249c6b8e09966020c6790-f7235fc7d04e4876","baggage":"sentry-trace_id=08f69b47d8b249c6b8e09966020c6790,sentry-release=Unknown"},"correlation_id":"01KZXXKHYBQV6GSR1GY1CC9BRA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:08.554Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-dc950af973e22aa0ea2ff7fa: done: 0.046142 sec","job_status":"done","queue_duration_s":3.584487,"scheduling_latency_s":3.584506,"redis_calls":10,"redis_duration_s":0.004719,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000491,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003079,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001149,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030491,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00043442,"duration_s":0.046142,"completed_at":"2026-08-13T16:01:12.185Z","load_balancing_strategy":"primary","db_duration_s":0.006078,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2210gitlab # [ 424.413081] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:12.187Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"fee84b29a3e4e1320e58836a","created_at":"2026-08-13T16:01:08.582Z","trace_propagation_headers":{"sentry-trace":"08f69b47d8b249c6b8e09966020c6790-f7235fc7d04e4876","baggage":"sentry-trace_id=08f69b47d8b249c6b8e09966020c6790,sentry-release=Unknown"},"correlation_id":"01KZXXKHYBQV6GSR1GY1CC9BRA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:08.590Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-fee84b29a3e4e1320e58836a: start","job_status":"start","queue_duration_s":3.59628,"scheduling_latency_s":3.596298}2211gitlab # [ 424.429089] nix-daemon[3737]: accepted connection from pid 4308, user nixbot2212gitlab # [ 424.430092] gitaly[895]: time="2026-08-13T16:01:12.131Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXPABR71VF08G0KQ3Y0CGB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T16:01:12.120" grpc.time_ms=10.431 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc2213gitlab # [ 424.444945] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:12.230Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"fee84b29a3e4e1320e58836a","created_at":"2026-08-13T16:01:08.582Z","trace_propagation_headers":{"sentry-trace":"08f69b47d8b249c6b8e09966020c6790-f7235fc7d04e4876","baggage":"sentry-trace_id=08f69b47d8b249c6b8e09966020c6790,sentry-release=Unknown"},"correlation_id":"01KZXXKHYBQV6GSR1GY1CC9BRA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:08.590Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-fee84b29a3e4e1320e58836a: done: 0.042867 sec","job_status":"done","queue_duration_s":3.59628,"scheduling_latency_s":3.596298,"redis_calls":13,"redis_duration_s":0.0025770000000000003,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000284,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001206,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000398,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000689,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029094,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00029676,"duration_s":0.042867,"completed_at":"2026-08-13T16:01:12.230Z","load_balancing_strategy":"primary","db_duration_s":0.004935,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2214gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'2215gitlab # [ 424.491311] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:12.232Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"4c4355391523e9ae58671999","created_at":"2026-08-13T16:01:08.592Z","trace_propagation_headers":{"sentry-trace":"08f69b47d8b249c6b8e09966020c6790-f7235fc7d04e4876","baggage":"sentry-trace_id=08f69b47d8b249c6b8e09966020c6790,sentry-release=Unknown"},"correlation_id":"01KZXXKHYBQV6GSR1GY1CC9BRA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:08.600Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-4c4355391523e9ae58671999: start","job_status":"start","queue_duration_s":3.631874,"scheduling_latency_s":3.631892}2216gitlab # [ 424.508357] gitlab-workhorse[821]: time="2026-08-13T16:01:12Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672217gitlab # [ 424.510059] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:16:01:12 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 682218gitlab # [ 424.511766] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:16:01:12 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 592219gitlab # [ 424.513847] gitaly[895]: time="2026-08-13T16:01:12.242Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXXPAF9449WJ5HKDQ0FAA3A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=196 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T16:01:12.228" grpc.time_ms=14.365 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc2220gitlab # [ 424.526119] gitaly[895]: time="2026-08-13T16:01:12.312Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZXXPAHM88CZM2TZS3CQXB91 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T16:01:12.302" pid=895 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2221gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.08 seconds)2222gitlab # [ 424.537266] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:12.272Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"4c4355391523e9ae58671999","created_at":"2026-08-13T16:01:08.592Z","trace_propagation_headers":{"sentry-trace":"08f69b47d8b249c6b8e09966020c6790-f7235fc7d04e4876","baggage":"sentry-trace_id=08f69b47d8b249c6b8e09966020c6790,sentry-release=Unknown"},"correlation_id":"01KZXXKHYBQV6GSR1GY1CC9BRA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:08.600Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-4c4355391523e9ae58671999: done: 0.040996 sec","job_status":"done","queue_duration_s":3.631874,"scheduling_latency_s":3.631892,"redis_calls":10,"redis_duration_s":0.003871,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000332,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002433,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001106,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026691,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00035384,"duration_s":0.040996,"completed_at":"2026-08-13T16:01:12.272Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004604,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2223gitlab # [ 424.582247] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:12.274Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"50c5a4bd199bb7763a21ede7","created_at":"2026-08-13T16:01:08.601Z","trace_propagation_headers":{"sentry-trace":"08f69b47d8b249c6b8e09966020c6790-f7235fc7d04e4876","baggage":"sentry-trace_id=08f69b47d8b249c6b8e09966020c6790,sentry-release=Unknown"},"correlation_id":"01KZXXKHYBQV6GSR1GY1CC9BRA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:08.608Z","job_size_bytes":19,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-50c5a4bd199bb7763a21ede7: start","job_status":"start","queue_duration_s":3.665416,"scheduling_latency_s":3.665434}2224gitlab # [ 424.599293] gitaly[895]: time="2026-08-13T16:01:12.312Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXPAHM88CZM2TZS3CQXB91 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T16:01:12.302" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc2225gitlab # [ 424.613170] gitlab-workhorse[821]: time="2026-08-13T16:01:12Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2212226gitlab # [ 424.614983] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:16:01:12 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 221 "" "git/2.55.0" 752227gitlab # [ 424.616937] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:12.309Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"50c5a4bd199bb7763a21ede7","created_at":"2026-08-13T16:01:08.601Z","trace_propagation_headers":{"sentry-trace":"08f69b47d8b249c6b8e09966020c6790-f7235fc7d04e4876","baggage":"sentry-trace_id=08f69b47d8b249c6b8e09966020c6790,sentry-release=Unknown"},"correlation_id":"01KZXXKHYBQV6GSR1GY1CC9BRA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:08.608Z","job_size_bytes":19,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-50c5a4bd199bb7763a21ede7: done: 0.034942 sec","job_status":"done","queue_duration_s":3.665416,"scheduling_latency_s":3.665434,"redis_calls":11,"redis_duration_s":0.002108,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000311,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001188,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000609,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022061,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034126,"duration_s":0.034942,"completed_at":"2026-08-13T16:01:12.309Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003713,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2228gitlab # [ 424.662536] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:12.310Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"f7aa173d78524d6b4e423ae1","created_at":"2026-08-13T16:01:08.614Z","trace_propagation_headers":{"sentry-trace":"08f69b47d8b249c6b8e09966020c6790-f7235fc7d04e4876","baggage":"sentry-trace_id=08f69b47d8b249c6b8e09966020c6790,sentry-release=Unknown"},"correlation_id":"01KZXXKHYBQV6GSR1GY1CC9BRA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:08.621Z","job_size_bytes":66,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-f7aa173d78524d6b4e423ae1: start","job_status":"start","queue_duration_s":3.689619,"scheduling_latency_s":3.689637}2229gitlab # [ 424.680557] nixbot[3524]: INFO: ::ffff:127.0.0.1:57706 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK2230gitlab # [ 424.682479] gitaly[895]: time="2026-08-13T16:01:12.312Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXPAHM88CZM2TZS3CQXB91 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T16:01:12.302" grpc.time_ms=10.839 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc2231gitlab # [ 424.697518] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:12.347Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"f7aa173d78524d6b4e423ae1","created_at":"2026-08-13T16:01:08.614Z","trace_propagation_headers":{"sentry-trace":"08f69b47d8b249c6b8e09966020c6790-f7235fc7d04e4876","baggage":"sentry-trace_id=08f69b47d8b249c6b8e09966020c6790,sentry-release=Unknown"},"correlation_id":"01KZXXKHYBQV6GSR1GY1CC9BRA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:08.621Z","job_size_bytes":66,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-f7aa173d78524d6b4e423ae1: done: 0.036508 sec","job_status":"done","queue_duration_s":3.689619,"scheduling_latency_s":3.689637,"redis_calls":10,"redis_duration_s":0.002767,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000433,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001418,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000916,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025262,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024416,"duration_s":0.036508,"completed_at":"2026-08-13T16:01:12.347Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004565,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2232gitlab # [ 424.743873] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:12.349Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"c1eebdcc5affb04c586a11ed","created_at":"2026-08-13T16:01:08.622Z","trace_propagation_headers":{"sentry-trace":"08f69b47d8b249c6b8e09966020c6790-f7235fc7d04e4876","baggage":"sentry-trace_id=08f69b47d8b249c6b8e09966020c6790,sentry-release=Unknown"},"correlation_id":"01KZXXKHYBQV6GSR1GY1CC9BRA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:08.628Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-c1eebdcc5affb04c586a11ed: start","job_status":"start","queue_duration_s":3.720565,"scheduling_latency_s":3.720583}2233gitlab # [ 424.760893] gitaly[895]: time="2026-08-13T16:01:12.410Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01KZXXPAMZTNE8GSB4XP3Q3A9Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T16:01:12.396" grpc.time_ms=13.936 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc2234gitlab # [ 424.774485] gitaly[895]: time="2026-08-13T16:01:12.487Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZXXPAPXYEC2WB76BWVNE9AQ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T16:01:12.464" pid=895 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=221 span.kind=server system=grpc2235gitlab # [ 424.785148] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:12.393Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"c1eebdcc5affb04c586a11ed","created_at":"2026-08-13T16:01:08.622Z","trace_propagation_headers":{"sentry-trace":"08f69b47d8b249c6b8e09966020c6790-f7235fc7d04e4876","baggage":"sentry-trace_id=08f69b47d8b249c6b8e09966020c6790,sentry-release=Unknown"},"correlation_id":"01KZXXKHYBQV6GSR1GY1CC9BRA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:08.628Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-c1eebdcc5affb04c586a11ed: done: 0.044677 sec","job_status":"done","queue_duration_s":3.720565,"scheduling_latency_s":3.720583,"redis_calls":10,"redis_duration_s":0.004020999999999999,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000352,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002678,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000991,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032197,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022628,"duration_s":0.044677,"completed_at":"2026-08-13T16:01:12.393Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005159,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2236gitlab # [ 424.830028] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:12.395Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"273eb7100555c06ad53b4d71","created_at":"2026-08-13T16:01:08.639Z","trace_propagation_headers":{"sentry-trace":"08f69b47d8b249c6b8e09966020c6790-f7235fc7d04e4876","baggage":"sentry-trace_id=08f69b47d8b249c6b8e09966020c6790,sentry-release=Unknown"},"correlation_id":"01KZXXKHYBQV6GSR1GY1CC9BRA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:08.644Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-273eb7100555c06ad53b4d71: start","job_status":"start","queue_duration_s":3.751413,"scheduling_latency_s":3.751432}2237gitlab # [ 424.846623] gitaly[895]: time="2026-08-13T16:01:12.488Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1103 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXPAPXYEC2WB76BWVNE9AQ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T16:01:12.464" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc2238gitlab # [ 424.861098] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:12.442Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"273eb7100555c06ad53b4d71","created_at":"2026-08-13T16:01:08.639Z","trace_propagation_headers":{"sentry-trace":"08f69b47d8b249c6b8e09966020c6790-f7235fc7d04e4876","baggage":"sentry-trace_id=08f69b47d8b249c6b8e09966020c6790,sentry-release=Unknown"},"correlation_id":"01KZXXKHYBQV6GSR1GY1CC9BRA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:08.644Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-273eb7100555c06ad53b4d71: done: 0.047294 sec","job_status":"done","queue_duration_s":3.751413,"scheduling_latency_s":3.751432,"redis_calls":10,"redis_duration_s":0.004031,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001637,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001833,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000561,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024118,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00044034,"duration_s":0.047294,"completed_at":"2026-08-13T16:01:12.442Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014189,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2239gitlab # [ 424.907199] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:12.447Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"b9237c72eabefbbe7bfa2b64","created_at":"2026-08-13T16:01:08.644Z","trace_propagation_headers":{"sentry-trace":"08f69b47d8b249c6b8e09966020c6790-f7235fc7d04e4876","baggage":"sentry-trace_id=08f69b47d8b249c6b8e09966020c6790,sentry-release=Unknown"},"correlation_id":"01KZXXKHYBQV6GSR1GY1CC9BRA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:08.650Z","job_size_bytes":6,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-b9237c72eabefbbe7bfa2b64: start","job_status":"start","queue_duration_s":3.797503,"scheduling_latency_s":3.797524}2240gitlab # [ 424.923787] gitaly[895]: time="2026-08-13T16:01:12.488Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1103 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXPAPXYEC2WB76BWVNE9AQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T16:01:12.464" grpc.time_ms=23.739 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc2241gitlab # [ 424.939766] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:12.484Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"b9237c72eabefbbe7bfa2b64","created_at":"2026-08-13T16:01:08.644Z","trace_propagation_headers":{"sentry-trace":"08f69b47d8b249c6b8e09966020c6790-f7235fc7d04e4876","baggage":"sentry-trace_id=08f69b47d8b249c6b8e09966020c6790,sentry-release=Unknown"},"correlation_id":"01KZXXKHYBQV6GSR1GY1CC9BRA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:08.650Z","job_size_bytes":6,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-b9237c72eabefbbe7bfa2b64: done: 0.037192 sec","job_status":"done","queue_duration_s":3.797503,"scheduling_latency_s":3.797524,"redis_calls":10,"redis_duration_s":0.005329,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000624,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001547,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003158,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016631,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003821,"duration_s":0.037192,"completed_at":"2026-08-13T16:01:12.484Z","load_balancing_strategy":"primary","db_duration_s":0.007574,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2242gitlab # [ 424.984507] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:12.486Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"d8be7b653524f8c8644c492c","created_at":"2026-08-13T16:01:08.650Z","trace_propagation_headers":{"sentry-trace":"08f69b47d8b249c6b8e09966020c6790-f7235fc7d04e4876","baggage":"sentry-trace_id=08f69b47d8b249c6b8e09966020c6790,sentry-release=Unknown"},"correlation_id":"01KZXXKHYBQV6GSR1GY1CC9BRA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:08.656Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-d8be7b653524f8c8644c492c: start","job_status":"start","queue_duration_s":3.829535,"scheduling_latency_s":3.829553}2243gitlab # [ 424.999919] gitaly[895]: time="2026-08-13T16:01:12.591Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXPATJNWWPTFFR9GEQ014R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T16:01:42.489" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T16:01:12.589" grpc.time_ms=1.091 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2244gitlab # [ 425.013866] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:12.533Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"d8be7b653524f8c8644c492c","created_at":"2026-08-13T16:01:08.650Z","trace_propagation_headers":{"sentry-trace":"08f69b47d8b249c6b8e09966020c6790-f7235fc7d04e4876","baggage":"sentry-trace_id=08f69b47d8b249c6b8e09966020c6790,sentry-release=Unknown"},"correlation_id":"01KZXXKHYBQV6GSR1GY1CC9BRA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:08.656Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-d8be7b653524f8c8644c492c: done: 0.047242 sec","job_status":"done","queue_duration_s":3.829535,"scheduling_latency_s":3.829553,"redis_calls":10,"redis_duration_s":0.003157,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000307,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001499,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001351,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026835,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024058,"duration_s":0.047242,"completed_at":"2026-08-13T16:01:12.533Z","load_balancing_strategy":"primary","db_duration_s":0.013412,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2245gitlab # [ 425.058153] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:12.535Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"4180b6dde653a4ac4eb17211","created_at":"2026-08-13T16:01:08.664Z","trace_propagation_headers":{"sentry-trace":"08f69b47d8b249c6b8e09966020c6790-f7235fc7d04e4876","baggage":"sentry-trace_id=08f69b47d8b249c6b8e09966020c6790,sentry-release=Unknown"},"correlation_id":"01KZXXKHYBQV6GSR1GY1CC9BRA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:08.669Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-4180b6dde653a4ac4eb17211: start","job_status":"start","queue_duration_s":3.865644,"scheduling_latency_s":3.865665}2246gitlab # [ 425.074640] gitaly[895]: time="2026-08-13T16:01:12.623Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=591 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZXXPATJNWWPTFFR9GEQ014R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-13T16:01:42.008" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T16:01:12.609" grpc.time_ms=14.101 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2247gitlab # [ 425.088985] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:12.611Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"4180b6dde653a4ac4eb17211","created_at":"2026-08-13T16:01:08.664Z","trace_propagation_headers":{"sentry-trace":"08f69b47d8b249c6b8e09966020c6790-f7235fc7d04e4876","baggage":"sentry-trace_id=08f69b47d8b249c6b8e09966020c6790,sentry-release=Unknown"},"correlation_id":"01KZXXKHYBQV6GSR1GY1CC9BRA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:08.669Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-4180b6dde653a4ac4eb17211: done: 0.075912 sec","job_status":"done","queue_duration_s":3.865644,"scheduling_latency_s":3.865665,"redis_calls":14,"redis_duration_s":0.007353,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000513,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005374,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001466,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046614,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00028322,"duration_s":0.075912,"completed_at":"2026-08-13T16:01:12.611Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018558,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2248gitlab # [ 425.134557] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:12.612Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"31088749e6cd0a6a1980171c","created_at":"2026-08-13T16:01:08.876Z","trace_propagation_headers":{"sentry-trace":"b0f29b1d8e2f4f118927dcd642e1b365-e1a81816572d4cea","baggage":"sentry-trace_id=b0f29b1d8e2f4f118927dcd642e1b365,sentry-release=Unknown"},"correlation_id":"01KZXXKB9SRRBN4XTJGZQPXG1C","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:08.882Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-31088749e6cd0a6a1980171c: start","job_status":"start","queue_duration_s":3.730536,"scheduling_latency_s":3.730555}2249gitlab # [ 425.151089] nixbot[3524]: {"ts": "2026-08-13T16:01:12.997Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 \"HTTP/1.1 201 Created\""}2250gitlab # [ 425.154138] nixbot[3524]: {"ts": "2026-08-13T16:01:13.003Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-a19390f81ad0-4"}2251gitlab # [ 425.156876] gitaly[895]: time="2026-08-13T16:01:12.655Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01KZXXPATJNWWPTFFR9GEQ014R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T16:01:22.081" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T16:01:12.641" grpc.time_ms=13.996 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2252gitlab # [ 425.170791] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:16:01:12 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 4652253gitlab # [ 425.173494] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:12.664Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"31088749e6cd0a6a1980171c","created_at":"2026-08-13T16:01:08.876Z","trace_propagation_headers":{"sentry-trace":"b0f29b1d8e2f4f118927dcd642e1b365-e1a81816572d4cea","baggage":"sentry-trace_id=b0f29b1d8e2f4f118927dcd642e1b365,sentry-release=Unknown"},"correlation_id":"01KZXXKB9SRRBN4XTJGZQPXG1C","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:08.882Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-31088749e6cd0a6a1980171c: done: 0.051873 sec","job_status":"done","queue_duration_s":3.730536,"scheduling_latency_s":3.730555,"redis_calls":19,"redis_duration_s":0.005308,"redis_read_bytes":21,"redis_write_bytes":4292,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000698,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000445,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2263,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002245,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00192,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037978,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00931152,"duration_s":0.051873,"completed_at":"2026-08-13T16:01:12.664Z","load_balancing_strategy":"primary","db_duration_s":0.005597,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2254gitlab # [ 425.218872] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:12.666Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","df02c56d6438114257845947"],"class":"WebHooks::LogExecutionWorker","jid":"aada8f5c0804d5cc16394283","created_at":"2026-08-13T16:01:10.675Z","trace_propagation_headers":{"sentry-trace":"b0f29b1d8e2f4f118927dcd642e1b365-7aaf43871c194410","baggage":"sentry-trace_id=b0f29b1d8e2f4f118927dcd642e1b365,sentry-release=Unknown"},"correlation_id":"01KZXXKB9SRRBN4XTJGZQPXG1C","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:81c6fb882bf90ffae7ed66a28ba7b36c69642ffddf5c582e8cbb591d9a500c6f","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:10.689Z","job_size_bytes":2592,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-aada8f5c0804d5cc16394283: start","job_status":"start","queue_duration_s":1.977024,"scheduling_latency_s":1.977046}2255gitlab # [ 425.236109] gitaly[895]: time="2026-08-13T16:01:12.711Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZXXPATJNWWPTFFR9GEQ014R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-13T16:01:22.149" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T16:01:12.710" grpc.time_ms=0.539 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2256gitlab # [ 425.246897] nix-daemon[3737]: accepted connection from pid 4396, user nixbot2257gitlab # [ 425.247845] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:12.711Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","df02c56d6438114257845947"],"class":"WebHooks::LogExecutionWorker","jid":"aada8f5c0804d5cc16394283","created_at":"2026-08-13T16:01:10.675Z","trace_propagation_headers":{"sentry-trace":"b0f29b1d8e2f4f118927dcd642e1b365-7aaf43871c194410","baggage":"sentry-trace_id=b0f29b1d8e2f4f118927dcd642e1b365,sentry-release=Unknown"},"correlation_id":"01KZXXKB9SRRBN4XTJGZQPXG1C","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:81c6fb882bf90ffae7ed66a28ba7b36c69642ffddf5c582e8cbb591d9a500c6f","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:10.689Z","job_size_bytes":2592,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-aada8f5c0804d5cc16394283: done: 0.045049 sec","job_status":"done","queue_duration_s":1.977024,"scheduling_latency_s":1.977046,"redis_calls":10,"redis_duration_s":0.0014399999999999999,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.0003,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000844,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000296,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032753,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002484,"duration_s":0.045049,"completed_at":"2026-08-13T16:01:12.711Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006675,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2258gitlab # [ 425.293529] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:12.713Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"e4fb932ae7082bd2532dbb4a","created_at":"2026-08-13T16:01:11.518Z","trace_propagation_headers":{"sentry-trace":"9cd7c9206b02471783efad2b0f1e8cb6-b1369f4e13ac4fe9","baggage":"sentry-trace_id=9cd7c9206b02471783efad2b0f1e8cb6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXXP9EE1A600KHAZWRTCTJM","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:11.526Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e4fb932ae7082bd2532dbb4a: start","job_status":"start","queue_duration_s":1.186506,"scheduling_latency_s":1.186525}2259gitlab # [ 425.311019] gitaly[895]: time="2026-08-13T16:01:12.738Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=3 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXPATJNWWPTFFR9GEQ014R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-13T16:01:22.160" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T16:01:12.721" grpc.time_ms=17.021 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2260gitlab # [ 425.325036] gitaly[895]: time="2026-08-13T16:01:12.797Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXXPATJNWWPTFFR9GEQ014R grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4153 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T16:01:12.795" grpc.time_ms=1.569 pid=895 span.kind=server system=grpc2261gitlab # [ 425.334886] nixbot[3524]: {"ts": "2026-08-13T16:01:13.217Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-a19390f81ad0-4", "argv0": "bwrap"}2262gitlab # [ 425.337344] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:13.079Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"e4fb932ae7082bd2532dbb4a","created_at":"2026-08-13T16:01:11.518Z","trace_propagation_headers":{"sentry-trace":"9cd7c9206b02471783efad2b0f1e8cb6-b1369f4e13ac4fe9","baggage":"sentry-trace_id=9cd7c9206b02471783efad2b0f1e8cb6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXXP9EE1A600KHAZWRTCTJM","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:11.526Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3502,"job_status":"rescheduled","message":"PipelineProcessWorker JID-e4fb932ae7082bd2532dbb4a: rescheduled"}2263gitlab # [ 425.352461] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:13.090Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"e4fb932ae7082bd2532dbb4a","created_at":"2026-08-13T16:01:11.518Z","trace_propagation_headers":{"sentry-trace":"9cd7c9206b02471783efad2b0f1e8cb6-b1369f4e13ac4fe9","baggage":"sentry-trace_id=9cd7c9206b02471783efad2b0f1e8cb6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXXP9EE1A600KHAZWRTCTJM","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:11.526Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e4fb932ae7082bd2532dbb4a: done: 0.376634 sec","job_status":"done","queue_duration_s":1.186506,"scheduling_latency_s":1.186525,"gitaly_calls":3,"gitaly_duration_s":0.142068,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.018704,"redis_read_bytes":150,"redis_write_bytes":18016,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000415,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001062,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.00526,"redis_queues_read_bytes":28,"redis_queues_write_bytes":12315,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.006983,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000211,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000775,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.003583,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.043,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.01,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.01,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.023,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.181095,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.3305125,"duration_s":0.376634,"completed_at":"2026-08-13T16:01:13.089Z","load_balancing_strategy":"primary","db_duration_s":0.044907,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2264gitlab # [ 425.405003] nix-daemon[3737]: accepted connection from pid 4404, user nixbot2265gitlab # [ 425.405978] gitaly[895]: time="2026-08-13T16:01:12.836Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXXP9EE1A600KHAZWRTCTJM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T16:01:12.836" grpc.time_ms=0.54 pid=895 span.kind=server system=grpc2266gitlab # [ 425.415864] gitaly[895]: time="2026-08-13T16:01:12.838Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXXPATJNWWPTFFR9GEQ014R grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T16:01:12.836" grpc.time_ms=1.225 pid=895 span.kind=server system=grpc2267gitlab # [ 425.425788] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:13.092Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","bf94ce8099cda47a685657e3"],"class":"WebHooks::LogExecutionWorker","jid":"efb603ddf5e19dca61c0a9b7","created_at":"2026-08-13T16:01:11.925Z","trace_propagation_headers":{"sentry-trace":"1256f8b2f82e4d768e0c21f6b7ec996e-ed56418ceca54218","baggage":"sentry-trace_id=1256f8b2f82e4d768e0c21f6b7ec996e,sentry-release=Unknown"},"correlation_id":"01KZXXKHAST32NPD9A1PGRMCDH","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f1b8af71418e5dc71428c757689d29cd47dfb86deea7d3b47bfb933a7921d4dd","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:11.931Z","job_size_bytes":2590,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-efb603ddf5e19dca61c0a9b7: start","job_status":"start","queue_duration_s":1.160819,"scheduling_latency_s":1.160852}2268gitlab # [ 425.442936] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:13.134Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","bf94ce8099cda47a685657e3"],"class":"WebHooks::LogExecutionWorker","jid":"efb603ddf5e19dca61c0a9b7","created_at":"2026-08-13T16:01:11.925Z","trace_propagation_headers":{"sentry-trace":"1256f8b2f82e4d768e0c21f6b7ec996e-ed56418ceca54218","baggage":"sentry-trace_id=1256f8b2f82e4d768e0c21f6b7ec996e,sentry-release=Unknown"},"correlation_id":"01KZXXKHAST32NPD9A1PGRMCDH","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f1b8af71418e5dc71428c757689d29cd47dfb86deea7d3b47bfb933a7921d4dd","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:11.931Z","job_size_bytes":2590,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-efb603ddf5e19dca61c0a9b7: done: 0.042028 sec","job_status":"done","queue_duration_s":1.160819,"scheduling_latency_s":1.160852,"redis_calls":7,"redis_duration_s":0.003073,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001102,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001971,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024796,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.042028,"completed_at":"2026-08-13T16:01:13.134Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010534,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2269gitlab # [ 425.487158] gitaly[895]: time="2026-08-13T16:01:12.852Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZXXPATJNWWPTFFR9GEQ014R diskcache=cb321d80-e1de-46aa-ba02-ba1bcf20dfb6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-13T16:01:22.181" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T16:01:12.742" pid=895 ref=refs/keep-around/a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 remote_ip="2001:db8:1::1" revision=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 span.kind=server system=grpc username=root2270gitlab # [ 425.499072] nix-daemon[3737]: accepted connection from pid 4414, user nixbot2271gitlab # [ 425.500089] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:13.136Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"ade0e414ba7fdab0b0532d03","created_at":"2026-08-13T16:01:12.647Z","trace_propagation_headers":{"sentry-trace":"b0f29b1d8e2f4f118927dcd642e1b365-2a10d4b3936e4f9d","baggage":"sentry-trace_id=b0f29b1d8e2f4f118927dcd642e1b365,sentry-release=Unknown"},"correlation_id":"01KZXXKB9SRRBN4XTJGZQPXG1C","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:12.654Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-ade0e414ba7fdab0b0532d03: start","job_status":"start","queue_duration_s":0.481806,"scheduling_latency_s":0.481834}2272gitlab # [ 425.518347] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:13.230Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"ade0e414ba7fdab0b0532d03","created_at":"2026-08-13T16:01:12.647Z","trace_propagation_headers":{"sentry-trace":"b0f29b1d8e2f4f118927dcd642e1b365-2a10d4b3936e4f9d","baggage":"sentry-trace_id=b0f29b1d8e2f4f118927dcd642e1b365,sentry-release=Unknown"},"correlation_id":"01KZXXKB9SRRBN4XTJGZQPXG1C","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:12.654Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-ade0e414ba7fdab0b0532d03: done: 0.093877 sec","job_status":"done","queue_duration_s":0.481806,"scheduling_latency_s":0.481834,"redis_calls":11,"redis_duration_s":0.00184,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000391,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00113,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000319,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.072745,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025714,"duration_s":0.093877,"completed_at":"2026-08-13T16:01:13.230Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016445,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2273gitlab # [ 425.564350] gitaly[895]: time="2026-08-13T16:01:12.852Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=93 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5250 command.oublock=8 command.real_time_ms=103 command.spawn_token_fork_ms=4 command.system_time_ms=47 command.user_time_ms=46 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXPATJNWWPTFFR9GEQ014R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-13T16:01:22.181" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T16:01:12.742" grpc.time_ms=110.495 pid=895 ref=refs/keep-around/a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 remote_ip="2001:db8:1::1" revision=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 span.kind=server system=grpc username=root2274gitlab # [ 425.579188] nix-daemon[3737]: accepted connection from pid 4425, user nixbot2275gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04'2276gitlab # [ 425.580145] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:13.231Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"06a9c7435950b8915059980c","created_at":"2026-08-13T16:01:12.782Z","trace_propagation_headers":{"sentry-trace":"9cd7c9206b02471783efad2b0f1e8cb6-44886291a2ba4902","baggage":"sentry-trace_id=9cd7c9206b02471783efad2b0f1e8cb6,sentry-release=Unknown"},"correlation_id":"01KZXXP9EE1A600KHAZWRTCTJM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:12.784Z","job_size_bytes":23,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-06a9c7435950b8915059980c: start","job_status":"start","queue_duration_s":0.446563,"scheduling_latency_s":0.446582}2277gitlab # [ 425.595115] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:13.275Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"06a9c7435950b8915059980c","created_at":"2026-08-13T16:01:12.782Z","trace_propagation_headers":{"sentry-trace":"9cd7c9206b02471783efad2b0f1e8cb6-44886291a2ba4902","baggage":"sentry-trace_id=9cd7c9206b02471783efad2b0f1e8cb6,sentry-release=Unknown"},"correlation_id":"01KZXXP9EE1A600KHAZWRTCTJM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:12.784Z","job_size_bytes":23,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-06a9c7435950b8915059980c: done: 0.044013 sec","job_status":"done","queue_duration_s":0.446563,"scheduling_latency_s":0.446582,"redis_calls":7,"redis_duration_s":0.001028,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000751,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000277,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032894,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.044013,"completed_at":"2026-08-13T16:01:13.275Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007934,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2278gitlab # [ 425.638720] gitaly[895]: time="2026-08-13T16:01:12.858Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXPATJNWWPTFFR9GEQ014R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T16:01:42.257" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T16:01:12.857" grpc.time_ms=0.612 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2279gitlab # [ 425.651863] gitaly[895]: time="2026-08-13T16:01:12.872Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXXP9EE1A600KHAZWRTCTJM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3895 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T16:01:12.870" grpc.time_ms=1.14 pid=895 span.kind=server system=grpc2280gitlab # [ 425.661927] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:13.276Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"55fdf37a11b319cdf81c501c","created_at":"2026-08-13T16:01:12.871Z","trace_propagation_headers":{"sentry-trace":"86ebfa74bb704f768cbe37abb9229923-fb617a73c2894c16","baggage":"sentry-trace_id=86ebfa74bb704f768cbe37abb9229923,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXXPATJNWWPTFFR9GEQ014R","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:12.877Z","job_size_bytes":65,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-55fdf37a11b319cdf81c501c: start","job_status":"start","queue_duration_s":0.399004,"scheduling_latency_s":0.399022}2281gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', in 0.12 seconds)2282(finished: subtest: push delivers the webhook, in 93.06 seconds)2283subtest: eval and build post commit statuses2284gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a19390f81ad0b5cd0bb453a70a8d42e2f9922b04/statuses2285gitlab # [ 425.679084] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:13.307Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"55fdf37a11b319cdf81c501c","created_at":"2026-08-13T16:01:12.871Z","trace_propagation_headers":{"sentry-trace":"86ebfa74bb704f768cbe37abb9229923-fb617a73c2894c16","baggage":"sentry-trace_id=86ebfa74bb704f768cbe37abb9229923,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXXPATJNWWPTFFR9GEQ014R","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:12.877Z","job_size_bytes":65,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-55fdf37a11b319cdf81c501c: done: 0.031088 sec","job_status":"done","queue_duration_s":0.399004,"scheduling_latency_s":0.399022,"redis_calls":7,"redis_duration_s":0.000995,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000733,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000262,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021385,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031088,"completed_at":"2026-08-13T16:01:13.307Z","load_balancing_strategy":"primary","db_duration_s":0.005689,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2286gitlab # [ 425.723751] nix-daemon[3737]: accepted connection from pid 4432, user nixbot2287gitlab # [ 425.724794] nix-daemon[3737]: accepted connection from pid 4414, user nixbot2288gitlab # [ 425.725757] gitaly[895]: time="2026-08-13T16:01:12.905Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXXP9EE1A600KHAZWRTCTJM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T16:01:12.904" grpc.time_ms=1.237 pid=895 span.kind=server system=grpc2289gitlab # [ 425.735604] gitaly[895]: time="2026-08-13T16:01:12.921Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZXXP9EE1A600KHAZWRTCTJM diskcache=047db54f-09cf-4c0b-b3b2-ed7824beda00 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-13T16:01:42.791" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-13T16:01:12.791" pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2290gitlab # [ 425.746042] nixbot[3524]: INFO: ::ffff:127.0.0.1:57712 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 HTTP/1.1" 200 OK2291gitlab # [ 425.748058] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:13.308Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"4fd02ccd980f2080f4a262db","created_at":"2026-08-13T16:01:12.878Z","trace_propagation_headers":{"sentry-trace":"86ebfa74bb704f768cbe37abb9229923-fb617a73c2894c16","baggage":"sentry-trace_id=86ebfa74bb704f768cbe37abb9229923,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXXPATJNWWPTFFR9GEQ014R","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:12.882Z","job_size_bytes":65,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-4fd02ccd980f2080f4a262db: start","job_status":"start","queue_duration_s":0.426732,"scheduling_latency_s":0.426751}2292gitlab # [ 425.765381] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:13.372Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"4fd02ccd980f2080f4a262db","created_at":"2026-08-13T16:01:12.878Z","trace_propagation_headers":{"sentry-trace":"86ebfa74bb704f768cbe37abb9229923-fb617a73c2894c16","baggage":"sentry-trace_id=86ebfa74bb704f768cbe37abb9229923,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXXPATJNWWPTFFR9GEQ014R","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:12.882Z","job_size_bytes":65,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-4fd02ccd980f2080f4a262db: done: 0.063985 sec","job_status":"done","queue_duration_s":0.426732,"scheduling_latency_s":0.426751,"redis_calls":10,"redis_duration_s":0.002088,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001212,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.000876,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043423,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.063985,"completed_at":"2026-08-13T16:01:13.372Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016063,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2293gitlab # [ 425.809410] gitaly[895]: time="2026-08-13T16:01:12.921Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=113 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7206 command.oublock=0 command.real_time_ms=125 command.spawn_token_fork_ms=0 command.system_time_ms=48 command.user_time_ms=65 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXP9EE1A600KHAZWRTCTJM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-13T16:01:42.791" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T16:01:12.791" grpc.time_ms=130.193 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2294gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a19390f81ad0b5cd0bb453a70a8d42e2f9922b04/statuses, in 0.14 seconds)2295gitlab # [ 425.822803] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:13.377Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"12383b3f4b18668134ba6bc1","created_at":"2026-08-13T16:01:12.928Z","trace_propagation_headers":{"sentry-trace":"9cd7c9206b02471783efad2b0f1e8cb6-44886291a2ba4902","baggage":"sentry-trace_id=9cd7c9206b02471783efad2b0f1e8cb6,sentry-release=Unknown"},"correlation_id":"01KZXXP9EE1A600KHAZWRTCTJM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:12.932Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-12383b3f4b18668134ba6bc1: start","job_status":"start","queue_duration_s":0.444568,"scheduling_latency_s":0.444613}2296gitlab # [ 425.839432] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:13.438Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"12383b3f4b18668134ba6bc1","created_at":"2026-08-13T16:01:12.928Z","trace_propagation_headers":{"sentry-trace":"9cd7c9206b02471783efad2b0f1e8cb6-44886291a2ba4902","baggage":"sentry-trace_id=9cd7c9206b02471783efad2b0f1e8cb6,sentry-release=Unknown"},"correlation_id":"01KZXXP9EE1A600KHAZWRTCTJM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:12.932Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-12383b3f4b18668134ba6bc1: done: 0.061648 sec","job_status":"done","queue_duration_s":0.444568,"scheduling_latency_s":0.444613,"redis_calls":7,"redis_duration_s":0.0023499999999999997,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001803,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000547,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.044446,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.061648,"completed_at":"2026-08-13T16:01:13.438Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00768,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2297gitlab # [ 425.882882] gitaly[895]: time="2026-08-13T16:01:13.018Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXXP9EE1A600KHAZWRTCTJM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-13T16:01:43.015" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T16:01:13.016" grpc.time_ms=2.047 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2298gitlab # [ 425.896213] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:16:01:13 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/a19390f81ad0b5cd0bb453a70a8d42e2f9922b04/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 962299gitlab # [ 425.898858] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:13.440Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"6a51e7008351862edb8e33d8","created_at":"2026-08-13T16:01:12.944Z","trace_propagation_headers":{"sentry-trace":"9cd7c9206b02471783efad2b0f1e8cb6-44886291a2ba4902","baggage":"sentry-trace_id=9cd7c9206b02471783efad2b0f1e8cb6,sentry-release=Unknown"},"correlation_id":"01KZXXP9EE1A600KHAZWRTCTJM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:12.949Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-6a51e7008351862edb8e33d8: start","job_status":"start","queue_duration_s":0.491175,"scheduling_latency_s":0.49121}2300gitlab # [ 425.915248] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:13.494Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"6a51e7008351862edb8e33d8","created_at":"2026-08-13T16:01:12.944Z","trace_propagation_headers":{"sentry-trace":"9cd7c9206b02471783efad2b0f1e8cb6-44886291a2ba4902","baggage":"sentry-trace_id=9cd7c9206b02471783efad2b0f1e8cb6,sentry-release=Unknown"},"correlation_id":"01KZXXP9EE1A600KHAZWRTCTJM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:12.949Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-6a51e7008351862edb8e33d8: done: 0.053367 sec","job_status":"done","queue_duration_s":0.491175,"scheduling_latency_s":0.49121,"redis_calls":7,"redis_duration_s":0.002474,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001753,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000721,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037011,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.053367,"completed_at":"2026-08-13T16:01:13.494Z","load_balancing_strategy":"primary","db_duration_s":0.008685,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2301gitlab # [ 425.958362] gitaly[895]: time="2026-08-13T16:01:13.067Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXP9EE1A600KHAZWRTCTJM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T16:01:43.066" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T16:01:13.066" grpc.time_ms=0.914 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2302gitlab # [ 425.971015] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:13.497Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"22efab4241b50f801964963d","created_at":"2026-08-13T16:01:12.964Z","trace_propagation_headers":{"sentry-trace":"9cd7c9206b02471783efad2b0f1e8cb6-44886291a2ba4902","baggage":"sentry-trace_id=9cd7c9206b02471783efad2b0f1e8cb6,sentry-release=Unknown"},"correlation_id":"01KZXXP9EE1A600KHAZWRTCTJM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:12.967Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-22efab4241b50f801964963d: start","job_status":"start","queue_duration_s":0.529369,"scheduling_latency_s":0.529409}2303gitlab # [ 425.987174] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:13.568Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"22efab4241b50f801964963d","created_at":"2026-08-13T16:01:12.964Z","trace_propagation_headers":{"sentry-trace":"9cd7c9206b02471783efad2b0f1e8cb6-44886291a2ba4902","baggage":"sentry-trace_id=9cd7c9206b02471783efad2b0f1e8cb6,sentry-release=Unknown"},"correlation_id":"01KZXXP9EE1A600KHAZWRTCTJM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:12.967Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-22efab4241b50f801964963d: done: 0.070978 sec","job_status":"done","queue_duration_s":0.529369,"scheduling_latency_s":0.529409,"redis_calls":10,"redis_duration_s":0.003265,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001842,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000817,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000606,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047278,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.070978,"completed_at":"2026-08-13T16:01:13.567Z","load_balancing_strategy":"primary","db_duration_s":0.011759,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2304gitlab # [ 426.031167] gitaly[895]: time="2026-08-13T16:01:13.708Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXPBXA6NMZ32P0B23CEKY2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T16:01:43.605" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T16:01:13.706" grpc.time_ms=1.014 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2305gitlab # [ 426.044539] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:13.570Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"7221feaaf989375931865f59","created_at":"2026-08-13T16:01:12.968Z","trace_propagation_headers":{"sentry-trace":"9cd7c9206b02471783efad2b0f1e8cb6-44886291a2ba4902","baggage":"sentry-trace_id=9cd7c9206b02471783efad2b0f1e8cb6,sentry-release=Unknown"},"correlation_id":"01KZXXP9EE1A600KHAZWRTCTJM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:12.973Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-7221feaaf989375931865f59: start","job_status":"start","queue_duration_s":0.596421,"scheduling_latency_s":0.596452}2306gitlab # [ 426.061597] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:13.618Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"7221feaaf989375931865f59","created_at":"2026-08-13T16:01:12.968Z","trace_propagation_headers":{"sentry-trace":"9cd7c9206b02471783efad2b0f1e8cb6-44886291a2ba4902","baggage":"sentry-trace_id=9cd7c9206b02471783efad2b0f1e8cb6,sentry-release=Unknown"},"correlation_id":"01KZXXP9EE1A600KHAZWRTCTJM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:12.973Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-7221feaaf989375931865f59: done: 0.047987 sec","job_status":"done","queue_duration_s":0.596421,"scheduling_latency_s":0.596452,"redis_calls":7,"redis_duration_s":0.001853,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001344,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000509,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029501,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.047987,"completed_at":"2026-08-13T16:01:13.618Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012133,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2307gitlab # [ 426.104740] gitaly[895]: time="2026-08-13T16:01:13.775Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXXPATJNWWPTFFR9GEQ014R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-13T16:01:43.772" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T16:01:13.773" grpc.time_ms=1.486 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2308gitlab # [ 426.117192] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:13.620Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"9208850da38f74278a0ac96a","created_at":"2026-08-13T16:01:12.975Z","trace_propagation_headers":{"sentry-trace":"9cd7c9206b02471783efad2b0f1e8cb6-44886291a2ba4902","baggage":"sentry-trace_id=9cd7c9206b02471783efad2b0f1e8cb6,sentry-release=Unknown"},"correlation_id":"01KZXXP9EE1A600KHAZWRTCTJM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:12.978Z","job_size_bytes":19,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-9208850da38f74278a0ac96a: start","job_status":"start","queue_duration_s":0.64149,"scheduling_latency_s":0.641518}2309gitlab # [ 426.133516] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:13.662Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"9208850da38f74278a0ac96a","created_at":"2026-08-13T16:01:12.975Z","trace_propagation_headers":{"sentry-trace":"9cd7c9206b02471783efad2b0f1e8cb6-44886291a2ba4902","baggage":"sentry-trace_id=9cd7c9206b02471783efad2b0f1e8cb6,sentry-release=Unknown"},"correlation_id":"01KZXXP9EE1A600KHAZWRTCTJM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:12.978Z","job_size_bytes":19,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-9208850da38f74278a0ac96a: done: 0.042817 sec","job_status":"done","queue_duration_s":0.64149,"scheduling_latency_s":0.641518,"redis_calls":8,"redis_duration_s":0.0026179999999999997,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002021,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000597,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02958,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.042817,"completed_at":"2026-08-13T16:01:13.662Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004612,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2310gitlab # [ 426.177846] gitaly[895]: time="2026-08-13T16:01:13.823Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXPATJNWWPTFFR9GEQ014R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T16:01:43.821" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T16:01:13.821" grpc.time_ms=1.129 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2311gitlab # [ 426.190398] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:13.666Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"41afce49f49078f082618766","created_at":"2026-08-13T16:01:12.975Z","trace_propagation_headers":{"sentry-trace":"86ebfa74bb704f768cbe37abb9229923-fb617a73c2894c16","baggage":"sentry-trace_id=86ebfa74bb704f768cbe37abb9229923,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXXPATJNWWPTFFR9GEQ014R","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:12.979Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-41afce49f49078f082618766: start","job_status":"start","queue_duration_s":0.686944,"scheduling_latency_s":0.68699}2312gitlab # [ 426.206557] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:13.844Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"41afce49f49078f082618766","created_at":"2026-08-13T16:01:12.975Z","trace_propagation_headers":{"sentry-trace":"86ebfa74bb704f768cbe37abb9229923-fb617a73c2894c16","baggage":"sentry-trace_id=86ebfa74bb704f768cbe37abb9229923,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXXPATJNWWPTFFR9GEQ014R","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:12.979Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-41afce49f49078f082618766: done: 0.178947 sec","job_status":"done","queue_duration_s":0.686944,"scheduling_latency_s":0.68699,"gitaly_calls":2,"gitaly_duration_s":0.008646,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.011362,"redis_read_bytes":79,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001963,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001554,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000414,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.0028,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000326,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000894,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001448,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.038,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.006,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.014,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.126756,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.12179548,"duration_s":0.178947,"completed_at":"2026-08-13T16:01:13.844Z","load_balancing_strategy":"primary","db_duration_s":0.040108,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2313gitlab # [ 426.258062] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:13.847Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"bcaf39c808afaed8dd20f4c5","created_at":"2026-08-13T16:01:12.979Z","trace_propagation_headers":{"sentry-trace":"9cd7c9206b02471783efad2b0f1e8cb6-44886291a2ba4902","baggage":"sentry-trace_id=9cd7c9206b02471783efad2b0f1e8cb6,sentry-release=Unknown"},"correlation_id":"01KZXXP9EE1A600KHAZWRTCTJM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:12.983Z","job_size_bytes":66,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-bcaf39c808afaed8dd20f4c5: start","job_status":"start","queue_duration_s":0.863333,"scheduling_latency_s":0.863362}2314gitlab # [ 426.275809] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:13.898Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"bcaf39c808afaed8dd20f4c5","created_at":"2026-08-13T16:01:12.979Z","trace_propagation_headers":{"sentry-trace":"9cd7c9206b02471783efad2b0f1e8cb6-44886291a2ba4902","baggage":"sentry-trace_id=9cd7c9206b02471783efad2b0f1e8cb6,sentry-release=Unknown"},"correlation_id":"01KZXXP9EE1A600KHAZWRTCTJM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:12.983Z","job_size_bytes":66,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-bcaf39c808afaed8dd20f4c5: done: 0.051754 sec","job_status":"done","queue_duration_s":0.863333,"scheduling_latency_s":0.863362,"redis_calls":7,"redis_duration_s":0.0033550000000000003,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00254,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000815,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039482,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.051754,"completed_at":"2026-08-13T16:01:13.898Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005716,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2315gitlab # [ 426.321042] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:13.902Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"4ffe140be2b0f15cdd27f8c0","created_at":"2026-08-13T16:01:12.984Z","trace_propagation_headers":{"sentry-trace":"9cd7c9206b02471783efad2b0f1e8cb6-44886291a2ba4902","baggage":"sentry-trace_id=9cd7c9206b02471783efad2b0f1e8cb6,sentry-release=Unknown"},"correlation_id":"01KZXXP9EE1A600KHAZWRTCTJM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:12.989Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-4ffe140be2b0f15cdd27f8c0: start","job_status":"start","queue_duration_s":0.912724,"scheduling_latency_s":0.912768}2316gitlab # [ 426.337471] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:13.952Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"4ffe140be2b0f15cdd27f8c0","created_at":"2026-08-13T16:01:12.984Z","trace_propagation_headers":{"sentry-trace":"9cd7c9206b02471783efad2b0f1e8cb6-44886291a2ba4902","baggage":"sentry-trace_id=9cd7c9206b02471783efad2b0f1e8cb6,sentry-release=Unknown"},"correlation_id":"01KZXXP9EE1A600KHAZWRTCTJM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:12.989Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-4ffe140be2b0f15cdd27f8c0: done: 0.050509 sec","job_status":"done","queue_duration_s":0.912724,"scheduling_latency_s":0.912768,"redis_calls":7,"redis_duration_s":0.002907,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002009,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000898,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034198,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.050509,"completed_at":"2026-08-13T16:01:13.952Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007765,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2317gitlab # [ 426.381865] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:13.955Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"1fb3ed27c84969e4fff72198","created_at":"2026-08-13T16:01:12.990Z","trace_propagation_headers":{"sentry-trace":"9cd7c9206b02471783efad2b0f1e8cb6-44886291a2ba4902","baggage":"sentry-trace_id=9cd7c9206b02471783efad2b0f1e8cb6,sentry-release=Unknown"},"correlation_id":"01KZXXP9EE1A600KHAZWRTCTJM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:12.994Z","job_size_bytes":6,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-1fb3ed27c84969e4fff72198: start","job_status":"start","queue_duration_s":0.961062,"scheduling_latency_s":0.961101}2318gitlab # [ 426.397826] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:13.980Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"1fb3ed27c84969e4fff72198","created_at":"2026-08-13T16:01:12.990Z","trace_propagation_headers":{"sentry-trace":"9cd7c9206b02471783efad2b0f1e8cb6-44886291a2ba4902","baggage":"sentry-trace_id=9cd7c9206b02471783efad2b0f1e8cb6,sentry-release=Unknown"},"correlation_id":"01KZXXP9EE1A600KHAZWRTCTJM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:12.994Z","job_size_bytes":6,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-1fb3ed27c84969e4fff72198: done: 0.025056 sec","job_status":"done","queue_duration_s":0.961062,"scheduling_latency_s":0.961101,"redis_calls":7,"redis_duration_s":0.002143,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001545,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000598,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016008,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025056,"completed_at":"2026-08-13T16:01:13.980Z","load_balancing_strategy":"primary","db_duration_s":0.000839,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2319gitlab # [ 426.440813] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:13.983Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"a079465912f866bc504b15dd","created_at":"2026-08-13T16:01:12.995Z","trace_propagation_headers":{"sentry-trace":"9cd7c9206b02471783efad2b0f1e8cb6-44886291a2ba4902","baggage":"sentry-trace_id=9cd7c9206b02471783efad2b0f1e8cb6,sentry-release=Unknown"},"correlation_id":"01KZXXP9EE1A600KHAZWRTCTJM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:12.999Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-a079465912f866bc504b15dd: start","job_status":"start","queue_duration_s":0.983225,"scheduling_latency_s":0.983257}2320gitlab # [ 426.456669] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:14.019Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"a079465912f866bc504b15dd","created_at":"2026-08-13T16:01:12.995Z","trace_propagation_headers":{"sentry-trace":"9cd7c9206b02471783efad2b0f1e8cb6-44886291a2ba4902","baggage":"sentry-trace_id=9cd7c9206b02471783efad2b0f1e8cb6,sentry-release=Unknown"},"correlation_id":"01KZXXP9EE1A600KHAZWRTCTJM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:12.999Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-a079465912f866bc504b15dd: done: 0.036749 sec","job_status":"done","queue_duration_s":0.983225,"scheduling_latency_s":0.983257,"redis_calls":7,"redis_duration_s":0.002251,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001643,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000608,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02452,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.036749,"completed_at":"2026-08-13T16:01:14.019Z","load_balancing_strategy":"primary","db_duration_s":0.005967,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2321gitlab # [ 426.498661] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:14.021Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"68386b659b80b66566e8b3aa","created_at":"2026-08-13T16:01:13.080Z","trace_propagation_headers":{"sentry-trace":"9cd7c9206b02471783efad2b0f1e8cb6-44886291a2ba4902","baggage":"sentry-trace_id=9cd7c9206b02471783efad2b0f1e8cb6,sentry-release=Unknown"},"correlation_id":"01KZXXP9EE1A600KHAZWRTCTJM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:13.083Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-68386b659b80b66566e8b3aa: start","job_status":"start","queue_duration_s":0.938757,"scheduling_latency_s":0.938789}2322gitlab # [ 426.514997] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:14.060Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"68386b659b80b66566e8b3aa","created_at":"2026-08-13T16:01:13.080Z","trace_propagation_headers":{"sentry-trace":"9cd7c9206b02471783efad2b0f1e8cb6-44886291a2ba4902","baggage":"sentry-trace_id=9cd7c9206b02471783efad2b0f1e8cb6,sentry-release=Unknown"},"correlation_id":"01KZXXP9EE1A600KHAZWRTCTJM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:13.083Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-68386b659b80b66566e8b3aa: done: 0.038528 sec","job_status":"done","queue_duration_s":0.938757,"scheduling_latency_s":0.938789,"redis_calls":8,"redis_duration_s":0.00253,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001927,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000603,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025862,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038528,"completed_at":"2026-08-13T16:01:14.060Z","load_balancing_strategy":"primary","db_duration_s":0.006491,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2323gitlab # [ 426.557534] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:14.062Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"a332e51f0f091885507d3a50","created_at":"2026-08-13T16:01:13.755Z","trace_propagation_headers":{"sentry-trace":"86ebfa74bb704f768cbe37abb9229923-0321d91520ed4807","baggage":"sentry-trace_id=86ebfa74bb704f768cbe37abb9229923,sentry-release=Unknown"},"correlation_id":"01KZXXPATJNWWPTFFR9GEQ014R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:13.757Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-a332e51f0f091885507d3a50: start","job_status":"start","queue_duration_s":0.304841,"scheduling_latency_s":0.304871}2324gitlab # [ 426.573905] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:14.107Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"a332e51f0f091885507d3a50","created_at":"2026-08-13T16:01:13.755Z","trace_propagation_headers":{"sentry-trace":"86ebfa74bb704f768cbe37abb9229923-0321d91520ed4807","baggage":"sentry-trace_id=86ebfa74bb704f768cbe37abb9229923,sentry-release=Unknown"},"correlation_id":"01KZXXPATJNWWPTFFR9GEQ014R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:13.757Z","job_size_bytes":3,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-a332e51f0f091885507d3a50: done: 0.044781 sec","job_status":"done","queue_duration_s":0.304841,"scheduling_latency_s":0.304871,"redis_calls":7,"redis_duration_s":0.001955,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001414,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000541,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03157,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.044781,"completed_at":"2026-08-13T16:01:14.107Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008277,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2325gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a19390f81ad0b5cd0bb453a70a8d42e2f9922b04/statuses2326gitlab # [ 427.031698] gitaly[895]: time="2026-08-13T16:01:14.945Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXPD2FE2PX726VR3DZQ8Q7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T16:01:44.342" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T16:01:14.943" grpc.time_ms=1.375 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2327gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a19390f81ad0b5cd0bb453a70a8d42e2f9922b04/statuses, in 0.26 seconds)2328gitlab # [ 427.094602] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:16:01:15 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/a19390f81ad0b5cd0bb453a70a8d42e2f9922b04/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1742329gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a19390f81ad0b5cd0bb453a70a8d42e2f9922b04/statuses2330gitlab # [ 428.256416] gitaly[895]: time="2026-08-13T16:01:16.168Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXPE90KZA4KMPFGC60WQQP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T16:01:46.066" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T16:01:16.167" grpc.time_ms=1.351 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2331gitlab # [ 428.313438] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:16:01:16 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/a19390f81ad0b5cd0bb453a70a8d42e2f9922b04/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1602332gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a19390f81ad0b5cd0bb453a70a8d42e2f9922b04/statuses, in 0.22 seconds)2333gitlab # [ 428.993153] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:16.904Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"3842c0a94759573d500d98df","created_at":"2026-08-13T16:01:16.691Z","trace_propagation_headers":{"sentry-trace":"c4f30d3145644ba0ad799618f0fc29cd-cbbecc32b74d49be","baggage":"sentry-trace_id=c4f30d3145644ba0ad799618f0fc29cd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b0d4410f897484ea36407316c001217e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:16.900Z","job_size_bytes":2,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-3842c0a94759573d500d98df: start","job_status":"start","queue_duration_s":0.003783,"scheduling_latency_s":0.003845}2334gitlab # [ 429.215754] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:17.128Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"3842c0a94759573d500d98df","created_at":"2026-08-13T16:01:16.691Z","trace_propagation_headers":{"sentry-trace":"c4f30d3145644ba0ad799618f0fc29cd-cbbecc32b74d49be","baggage":"sentry-trace_id=c4f30d3145644ba0ad799618f0fc29cd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b0d4410f897484ea36407316c001217e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:16.900Z","job_size_bytes":2,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-3842c0a94759573d500d98df: done: 0.22353 sec","job_status":"done","queue_duration_s":0.003783,"scheduling_latency_s":0.003845,"redis_calls":11,"redis_duration_s":0.022736,"redis_read_bytes":9,"redis_write_bytes":1386,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.013428,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00687,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002438,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.053084,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.22353,"completed_at":"2026-08-13T16:01:17.128Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.036337,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2335gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a19390f81ad0b5cd0bb453a70a8d42e2f9922b04/statuses2336gitlab # [ 429.312431] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:17.137Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"efdae7d0b728759093bb62b2","created_at":"2026-08-13T16:01:16.949Z","trace_propagation_headers":{"sentry-trace":"c4f30d3145644ba0ad799618f0fc29cd-cbbecc32b74d49be","baggage":"sentry-trace_id=c4f30d3145644ba0ad799618f0fc29cd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"49769bd449ed986c534f7da9009ede41","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-13T16:01:16.966Z","job_size_bytes":2,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-efdae7d0b728759093bb62b2: start","job_status":"start","queue_duration_s":0.171231,"scheduling_latency_s":0.17128}2337gitlab # [ 429.465826] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:17.377Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"efdae7d0b728759093bb62b2","created_at":"2026-08-13T16:01:16.949Z","trace_propagation_headers":{"sentry-trace":"c4f30d3145644ba0ad799618f0fc29cd-cbbecc32b74d49be","baggage":"sentry-trace_id=c4f30d3145644ba0ad799618f0fc29cd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"49769bd449ed986c534f7da9009ede41","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-13T16:01:16.966Z","job_size_bytes":2,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-efdae7d0b728759093bb62b2: done: 0.240034 sec","job_status":"done","queue_duration_s":0.171231,"scheduling_latency_s":0.17128,"redis_calls":10,"redis_duration_s":0.019034,"redis_read_bytes":41,"redis_write_bytes":1103,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.005174,"redis_feature_flag_read_bytes":36,"redis_feature_flag_write_bytes":362,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.010112,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003748,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.043,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.043,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.063195,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.240034,"completed_at":"2026-08-13T16:01:17.377Z","load_balancing_strategy":"primary","db_duration_s":0.058715,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2338gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a19390f81ad0b5cd0bb453a70a8d42e2f9922b04/statuses, in 0.24 seconds)2339gitlab # [ 429.560421] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:17.385Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"14095ca9d9107cfaba2aa6c9","created_at":"2026-08-13T16:01:17.003Z","trace_propagation_headers":{"sentry-trace":"c4f30d3145644ba0ad799618f0fc29cd-cbbecc32b74d49be","baggage":"sentry-trace_id=c4f30d3145644ba0ad799618f0fc29cd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3433389c5df697e57b8696b09f2e4383","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:17.018Z","job_size_bytes":2,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-14095ca9d9107cfaba2aa6c9: start","job_status":"start","queue_duration_s":0.366723,"scheduling_latency_s":0.366782}2340gitlab # [ 429.585030] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/13:16:01:17 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/a19390f81ad0b5cd0bb453a70a8d42e2f9922b04/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1522341gitlab # [ 429.589846] gitaly[895]: time="2026-08-13T16:01:17.394Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXPFFE5856ER4DFDEK3Q8B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T16:01:47.292" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T16:01:17.393" grpc.time_ms=1.175 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2342gitlab # [ 430.360122] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:18.272Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"14095ca9d9107cfaba2aa6c9","created_at":"2026-08-13T16:01:17.003Z","trace_propagation_headers":{"sentry-trace":"c4f30d3145644ba0ad799618f0fc29cd-cbbecc32b74d49be","baggage":"sentry-trace_id=c4f30d3145644ba0ad799618f0fc29cd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3433389c5df697e57b8696b09f2e4383","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:17.018Z","job_size_bytes":2,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-14095ca9d9107cfaba2aa6c9: done: 0.88656 sec","job_status":"done","queue_duration_s":0.366723,"scheduling_latency_s":0.366782,"redis_calls":13,"redis_duration_s":0.007592,"redis_read_bytes":11,"redis_write_bytes":1563,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000931,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":576,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001246,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.005415,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.2,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.176,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.467697,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.005326,"exclusive_lock_hold_duration_s":0.78533534,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.88656,"completed_at":"2026-08-13T16:01:18.272Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.399426,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2343gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a19390f81ad0b5cd0bb453a70a8d42e2f9922b04/statuses2344gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a19390f81ad0b5cd0bb453a70a8d42e2f9922b04/statuses, in 0.17 seconds)2345gitlab # [ 430.360901] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:18.274Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"6916ce09bf67e33ebea13b09","created_at":"2026-08-13T16:01:17.041Z","trace_propagation_headers":{"sentry-trace":"c4f30d3145644ba0ad799618f0fc29cd-cbbecc32b74d49be","baggage":"sentry-trace_id=c4f30d3145644ba0ad799618f0fc29cd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"25abf2dec6f0b1f0e5cfd7300bc2a202","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:17.069Z","job_size_bytes":2,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-6916ce09bf67e33ebea13b09: start","job_status":"start","queue_duration_s":1.204538,"scheduling_latency_s":1.204564}2346gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a19390f81ad0b5cd0bb453a70a8d42e2f9922b04/statuses2347gitlab # [ 430.455552] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:18.309Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"6916ce09bf67e33ebea13b09","created_at":"2026-08-13T16:01:17.041Z","trace_propagation_headers":{"sentry-trace":"c4f30d3145644ba0ad799618f0fc29cd-cbbecc32b74d49be","baggage":"sentry-trace_id=c4f30d3145644ba0ad799618f0fc29cd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"25abf2dec6f0b1f0e5cfd7300bc2a202","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:17.069Z","job_size_bytes":2,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-6916ce09bf67e33ebea13b09: done: 0.035395 sec","job_status":"done","queue_duration_s":1.204538,"scheduling_latency_s":1.204564,"redis_calls":12,"redis_duration_s":0.003437,"redis_read_bytes":10,"redis_write_bytes":1576,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000553,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001681,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001203,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021617,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01058776,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.035395,"completed_at":"2026-08-13T16:01:18.309Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005373,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2348gitlab # [ 431.126007] sidekiq-cluster[3502]: {"severity":"INFO","time":"2026-08-13T16:01:18.311Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"b121214e151eb8c40091f80d","created_at":"2026-08-13T16:01:17.094Z","trace_propagation_headers":{"sentry-trace":"c4f30d3145644ba0ad799618f0fc29cd-cbbecc32b74d49be","baggage":"sentry-trace_id=c4f30d3145644ba0ad799618f0fc29cd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"72b26132b37ce1247d6c14dce89f10d1","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-13T16:01:17.131Z","job_size_bytes":2,"pid":3502,"sidekiq_tid":"m8r6","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-b121214e151eb8c40091f80d: start","job_status":"start","queue_duration_s":1.179539,"scheduling_latency_s":1.17956}2349gitlab # [ 431.126565] gitaly[895]: time="2026-08-13T16:01:18.554Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXXPGKKG74Q03P5WNPQP6DG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T16:01:48.451" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T16:01:18.552" grpc.time_ms=1.548 pid=895 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2350gitlab # [ 431.126941] nixbot[3524]: {"ts": "2026-08-13T16:01:18.744Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 \"HTTP/1.1 201 Created\""}2351gitlab # [ 431.127016] nixbot[3524]: {"ts": "2026-08-13T16:01:18.963Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a19390f81ad0b5cd0bb453a70a8d42e2f9922b04 \"HTTP/1.1 201 Created\""}2352gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a19390f81ad0b5cd0bb453a70a8d42e2f9922b04/statuses, in 0.16 seconds)2353(finished: subtest: eval and build post commit statuses, in 6.19 seconds)2354(finished: run the VM test script, in 501.37 seconds)2355test script finished in 501.41s2356cleanup2357kill QemuMachine (pid 46)2358gitlab # [ 431.127083] sidekiq-cluster[3502]: {"severity":"INFO","tiqemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/41m77i1296n33p6liin8ynr6wh3h6b7m-python3-3.14.6/bin/python3.14)2359(finished: cleanup, in 1.45 seconds)2360additionally exposed symbols:2361 gitlab,2362 vlan1,2363 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2364[]2365[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-08-13T15:59:39.594Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2366[]2367[]2368[]2369[]2370[]2371[]2372[]2373[]2374[]2375[]2376[]2377[]2378[]2379[]2380[]2381[]2382[]2383[]2384[]2385[]2386[]2387[]2388[]2389[]2390[]2391[]2392[]2393[]2394[]2395[]2396[]2397[]2398[]2399[]2400[]2401[]2402[]2403[]2404[]2405[]2406[]2407[]2408[]2409[]2410[]2411[]2412[]2413[]2414[]2415[]2416[]2417[]2418[]2419[]2420[]2421[]2422[]2423[]2424[]2425[]2426[]2427[]2428[]2429[]2430[]2431[]2432[]2433[]2434[]2435[]2436[]2437[]2438[]2439[]2440[]2441[]2442[]2443[]2444[]2445[]2446[]2447[]2448[]2449[]2450[]2451[]2452[]2453[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': 'a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': [{'level': 'warning', 'message': "could not read HEAD ref from repo at '/var/lib/nixbot/worktrees/1-a19390f81ad0-4', using 'master'", 'count': 1}], 'error': None, 'created_at': '2026-08-13T16:01:12.522101Z', 'started_at': '2026-08-13T16:01:12.999500Z', 'finished_at': None}]2454[{'id': 5, 'sha': 'a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-13T16:01:12.966Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2455[{'id': 5, 'sha': 'a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-13T16:01:12.966Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2456[{'id': 5, 'sha': 'a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-13T16:01:12.966Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2457[{'id': 5, 'sha': 'a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-13T16:01:12.966Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2458[{'id': 5, 'sha': 'a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-13T16:01:12.966Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2459[{'id': 5, 'sha': 'a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (2 warnings)', 'created_at': '2026-08-13T16:01:12.966Z', 'started_at': None, 'finished_at': '2026-08-13T16:01:18.691Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': 'a19390f81ad0b5cd0bb453a70a8d42e2f9922b04', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '0 attributes built', 'created_at': '2026-08-13T16:01:18.928Z', 'started_at': None, 'finished_at': '2026-08-13T16:01:19.378Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]