vm-test-run-nixbot-gitlab
checks.aarch64-linux.nixbot-gitlab
· build #274
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 46)10gitlab # Disk image does not exist, creating the virtualisation disk image...11gitlab # Formatting '/build/vm-state-gitlab/tmp.D9eW2kAwv7', fmt=raw size=107374182412(finished: start all VMs, in 70.97 seconds)13gitlab # mke2fs 1.47.4 (6-Mar-2025)14gitlab: waiting for unit setup-gitlab.service15gitlab # Discarding device blocks: 0/262144 done16gitlab: waiting for the VM to finish booting17gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes18gitlab # Filesystem UUID: befa21e7-cf5b-4f46-a35d-4108897c4c6319gitlab # Superblock backups stored on blocks:20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]31gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Thu Aug 6 17:27:09 UTC 202632gitlab # [ 0.000000] KASLR enabled33gitlab # [ 0.000000] random: crng init done34gitlab # [ 0.000000] Machine model: linux,dummy-virt35gitlab # [ 0.000000] efi: UEFI not found.36gitlab # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT37gitlab # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff]38gitlab # [ 0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf]39gitlab # [ 0.000000] Zone ranges:40gitlab # [ 0.000000] DMA [mem 0x0000000040000000-0x00000000ffffffff]41gitlab # [ 0.000000] DMA32 empty42gitlab # [ 0.000000] Normal [mem 0x0000000100000000-0x00000001bfffffff]43gitlab # [ 0.000000] Device empty44gitlab # [ 0.000000] Movable zone start for each node45gitlab # [ 0.000000] Early memory node ranges46gitlab # [ 0.000000] node 0: [mem 0x0000000040000000-0x00000001bfffffff]47gitlab # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff]48gitlab # [ 0.000000] cma: Reserved 32 MiB at 0x00000000fe00000049gitlab # [ 0.000000] psci: probing for conduit method from DT.50gitlab # [ 0.000000] psci: PSCIv1.3 detected in firmware.51gitlab # [ 0.000000] psci: Using standard PSCI v0.2 function IDs52gitlab # [ 0.000000] psci: Trusted OS migration not required53gitlab # [ 0.000000] psci: SMC Calling Convention v1.154gitlab # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)55gitlab # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u31129656gitlab # [ 0.000000] Detected PIPT I-cache on CPU057gitlab # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)58gitlab # [ 0.000000] CPU features: detected: GICv3 CPU interface59gitlab # [ 0.000000] CPU features: detected: Spectre-v460gitlab # [ 0.000000] CPU features: detected: Spectre-BHB61gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_3862gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_2363gitlab # [ 0.000000] alternatives: applying boot alternatives64gitlab # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/nqm4dkvrqgia6mhfac4wglpnflj8av0m-nixos-system-gitlab-test/init regInfo=/nix/store/5gds7kjfra8lgcr51lc8vxj2qylnd6ia-closure-info/registration console=ttyAMA0,115200n8 console=tty065gitlab # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/5gds7kjfra8lgcr51lc8vxj2qylnd6ia-closure-info/registration", will be passed to user space.66gitlab # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes67gitlab # [ 0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)68gitlab # [ 0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)69gitlab # [ 0.000000] software IO TLB: area num 4.70gitlab # [ 0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB)71gitlab # [ 0.000000] Fallback order for Node 0: 072gitlab # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 157286473gitlab # [ 0.000000] Policy zone: Normal74gitlab # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off75gitlab # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=176gitlab # [ 0.000000] allocated 12582912 bytes of page_ext77gitlab # [ 0.000000] ftrace: allocating 74867 entries in 294 pages78gitlab # [ 0.000000] ftrace: allocated 294 pages with 4 groups79gitlab # [ 0.000000] rcu: Hierarchical RCU implementation.80gitlab # [ 0.000000] rcu: RCU event tracing is enabled.81gitlab # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.82gitlab # [ 0.000000] Trampoline variant of Tasks RCU enabled.83gitlab # [ 0.000000] Rude variant of Tasks RCU enabled.84gitlab # [ 0.000000] Tracing variant of Tasks RCU enabled.85gitlab # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.86gitlab # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=487gitlab # [ 0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.88gitlab # [ 0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.89gitlab # [ 0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.90gitlab # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 091gitlab # [ 0.000000] GICv3: 256 SPIs implemented92gitlab # [ 0.000000] GICv3: 0 Extended SPIs implemented93gitlab # [ 0.000000] Root IRQ handler: gic_handle_irq94gitlab # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI95gitlab # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=096gitlab # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a000097gitlab # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]98gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f10000 (indirect, esz 8, psz 64K, shr 1)99gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f20000 (flat, esz 8, psz 64K, shr 1)100gitlab # [ 0.000000] GICv3: using LPI property table @0x0000000100f30000101gitlab # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f40000102gitlab # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.103gitlab # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns104gitlab # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).105gitlab # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns106gitlab # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns107gitlab # [ 0.000029] arm-pv: using stolen time PV108gitlab # [ 0.000369] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)109gitlab # [ 0.000536] Console: colour dummy device 80x25110gitlab # [ 0.000543] printk: legacy console [tty0] enabled111gitlab # [ 0.000724] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)112gitlab # [ 0.000730] pid_max: default: 32768 minimum: 301113gitlab # [ 0.000806] LSM: initializing lsm=capability,landlock,yama,bpf,ima114gitlab # [ 0.000936] landlock: Up and running.115gitlab # [ 0.000938] Yama: becoming mindful.116gitlab # [ 0.001360] LSM support for eBPF active117gitlab # [ 0.001526] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)118gitlab # [ 0.001629] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)119gitlab # [ 0.002796] cacheinfo: Unable to detect cache hierarchy for CPU 0120gitlab # [ 0.003454] rcu: Hierarchical SRCU implementation.121gitlab # [ 0.003458] rcu: Max phase no-delay instances is 1000.122gitlab # [ 0.003616] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level123gitlab # [ 0.004591] fsl-mc MSI: its@8080000 domain created124gitlab # [ 0.004679] EFI services will not be available.125gitlab # [ 0.004827] smp: Bringing up secondary CPUs ...126gitlab # [ 0.005450] Detected PIPT I-cache on CPU1127gitlab # [ 0.005550] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000128gitlab # [ 0.005671] GICv3: CPU1: using allocated LPI pending table @0x0000000100f50000129gitlab # [ 0.005794] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40]130gitlab # [ 0.006831] Detected PIPT I-cache on CPU2131gitlab # [ 0.006938] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000132gitlab # [ 0.007059] GICv3: CPU2: using allocated LPI pending table @0x0000000100f60000133gitlab # [ 0.007184] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40]134gitlab # [ 0.008235] Detected PIPT I-cache on CPU3135gitlab # [ 0.008352] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000136gitlab # [ 0.008475] GICv3: CPU3: using allocated LPI pending table @0x0000000100f70000137gitlab # [ 0.008601] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40]138gitlab # [ 0.009104] smp: Brought up 1 node, 4 CPUs139gitlab # [ 0.009130] SMP: Total of 4 processors activated.140gitlab # [ 0.009132] CPU: All CPU(s) started at EL1141gitlab # [ 0.009140] CPU features: detected: Branch Target Identification142gitlab # [ 0.009144] CPU features: detected: ARMv8.4 Translation Table Level143gitlab # [ 0.009147] CPU features: detected: Instruction cache invalidation not required for I/D coherence144gitlab # [ 0.009150] CPU features: detected: Data cache clean to the PoU not required for I/D coherence145gitlab # [ 0.009153] CPU features: detected: Common not Private translations146gitlab # [ 0.009156] CPU features: detected: CRC32 instructions147gitlab # [ 0.009158] CPU features: detected: Data cache clean to Point of Deep Persistence148gitlab # [ 0.009162] CPU features: detected: Data cache clean to Point of Persistence149gitlab # [ 0.009165] CPU features: detected: Data independent timing control (DIT)150gitlab # [ 0.009167] CPU features: detected: E0PD151gitlab # [ 0.009169] CPU features: detected: Enhanced Counter Virtualization152gitlab # [ 0.009172] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)153gitlab # [ 0.009175] CPU features: detected: Enhanced Virtualization Traps154gitlab # [ 0.009178] CPU features: detected: Fine Grained Traps155gitlab # [ 0.009181] CPU features: detected: Generic authentication (architected QARMA5 algorithm)156gitlab # [ 0.009185] CPU features: detected: RCpc load-acquire (LDAPR)157gitlab # [ 0.009187] CPU features: detected: LSE atomic instructions158gitlab # [ 0.009190] CPU features: detected: Privileged Access Never159gitlab # [ 0.009192] CPU features: detected: PMUv3160gitlab # [ 0.009195] CPU features: detected: RAS Extension Support161gitlab # [ 0.009197] CPU features: detected: RASv1p1 Extension Support162gitlab # [ 0.009200] CPU features: detected: Random Number Generator163gitlab # [ 0.009202] CPU features: detected: Speculation barrier (SB)164gitlab # [ 0.009205] CPU features: detected: Stage-2 Force Write-Back165gitlab # [ 0.009207] CPU features: detected: TLB range maintenance instructions166gitlab # [ 0.009210] CPU features: detected: Speculative Store Bypassing Safe (SSBS)167gitlab # [ 0.009344] alternatives: applying system-wide alternatives168gitlab # [ 0.013874] CPU features: detected: BBM Level 2 without TLB conflict abort169gitlab # [ 0.014090] Memory: 5963808K/6291456K available (24448K kernel code, 7090K rwdata, 26340K rodata, 4736K init, 1106K bss, 272908K reserved, 32768K cma-reserved)170gitlab # [ 0.015491] devtmpfs: initialized171gitlab # [ 0.019371] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)172gitlab # [ 0.019445] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).173gitlab # [ 0.019637] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL174gitlab # [ 0.019642] 0 pages in range for non-PLT usage175gitlab # [ 0.019643] 508288 pages in range for PLT usage176gitlab # [ 0.019769] pinctrl core: initialized pinctrl subsystem177gitlab # [ 0.020545] DMI not present or invalid.178gitlab # [ 0.023599] NET: Registered PF_NETLINK/PF_ROUTE protocol family179gitlab # [ 0.026066] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations180gitlab # [ 0.026340] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations181gitlab # [ 0.028053] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations182gitlab # [ 0.028074] audit: initializing netlink subsys (disabled)183gitlab # [ 0.028388] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1184gitlab # [ 0.028843] thermal_sys: Registered thermal governor 'fair_share'185gitlab # [ 0.028846] thermal_sys: Registered thermal governor 'bang_bang'186gitlab # [ 0.028850] thermal_sys: Registered thermal governor 'step_wise'187gitlab # [ 0.028853] thermal_sys: Registered thermal governor 'user_space'188gitlab # [ 0.028855] thermal_sys: Registered thermal governor 'power_allocator'189gitlab # [ 0.028938] cpuidle: using governor ladder190gitlab # [ 0.028961] cpuidle: using governor menu191gitlab # [ 0.029166] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.192gitlab # [ 0.029374] ASID allocator initialised with 65536 entries193gitlab # [ 0.030471] Serial: AMBA PL011 UART driver194gitlab # [ 0.035560] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1195gitlab # [ 0.035847] printk: console [ttyAMA0] enabled196gitlab # [ 0.048454] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages197gitlab # [ 0.048477] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page198gitlab # [ 0.048487] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages199gitlab # [ 0.048496] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page200gitlab # [ 0.048504] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages201gitlab # [ 0.048512] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page202gitlab # [ 0.048520] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages203gitlab # [ 0.048528] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page204gitlab # [ 0.059989] fbcon: Taking over console205gitlab # [ 0.060000] ACPI: Interpreter disabled.206gitlab # [ 0.061024] iommu: Default domain type: Translated207gitlab # [ 0.061042] iommu: DMA domain TLB invalidation policy: strict mode208gitlab # [ 0.070876] SCSI subsystem initialized209gitlab # [ 0.071285] usbcore: registered new interface driver usbfs210gitlab # [ 0.071309] usbcore: registered new interface driver hub211gitlab # [ 0.071326] usbcore: registered new device driver usb212gitlab # [ 0.071602] pps_core: LinuxPPS API ver. 1 registered213gitlab # [ 0.071606] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>214gitlab # [ 0.071614] PTP clock support registered215gitlab # [ 0.071653] EDAC MC: Ver: 3.0.0216gitlab # [ 0.072125] scmi_core: SCMI protocol bus registered217gitlab # [ 0.073112] FPGA manager framework218gitlab # [ 0.073876] vgaarb: loaded219gitlab # [ 0.076289] clocksource: Switched to clocksource arch_sys_counter220gitlab # [ 0.095567] VFS: Disk quotas dquot_6.6.0221gitlab # [ 0.095631] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)222gitlab # [ 0.096556] netfs: FS-Cache loaded223gitlab # [ 0.096849] pnp: PnP ACPI: disabled224gitlab # [ 0.107968] NET: Registered PF_INET protocol family225gitlab # [ 0.110515] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)226gitlab # [ 0.169703] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)227gitlab # [ 0.169772] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)228gitlab # [ 0.169832] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)229gitlab # [ 0.170240] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)230gitlab # [ 0.171157] TCP: Hash tables configured (established 65536 bind 65536)231gitlab # [ 0.171296] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)232gitlab # [ 0.171395] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)233gitlab # [ 0.171589] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)234gitlab # [ 0.171857] NET: Registered PF_UNIX/PF_LOCAL protocol family235gitlab # [ 0.171889] NET: Registered PF_XDP protocol family236gitlab # [ 0.171908] PCI: CLS 0 bytes, default 64237gitlab # [ 0.172396] Trying to unpack rootfs image as initramfs...238gitlab # [ 0.176360] kvm [1]: HYP mode not available239gitlab # [ 0.236960] Initialise system trusted keyrings240gitlab # [ 0.237353] workingset: timestamp_bits=42 max_order=21 bucket_order=0241gitlab # [ 0.240759] squashfs: version 4.0 (2009/01/31) Phillip Lougher242gitlab # [ 0.244406] 9p: Installing v9fs 9p2000 file system support243gitlab # [ 0.264191] Key type asymmetric registered244gitlab # [ 0.264211] Asymmetric key parser 'x509' registered245gitlab # [ 0.264337] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)246gitlab # [ 0.264477] io scheduler mq-deadline registered247gitlab # [ 0.264482] io scheduler kyber registered248gitlab # [ 0.274704] pl061_gpio 9030000.pl061: PL061 GPIO chip registered249gitlab # [ 0.276374] ledtrig-cpu: registered to indicate activity on CPUs250gitlab # [ 0.276868] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:251gitlab # [ 0.276886] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000252gitlab # [ 0.276898] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000253gitlab # [ 0.276907] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000254gitlab # [ 0.276932] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits255gitlab # [ 0.276958] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]256gitlab # [ 0.277050] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00257gitlab # [ 0.277059] pci_bus 0000:00: root bus resource [bus 00-ff]258gitlab # [ 0.277064] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]259gitlab # [ 0.277068] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]260gitlab # [ 0.277073] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]261gitlab # [ 0.277204] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint262gitlab # [ 0.278052] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint263gitlab # [ 0.278451] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]264gitlab # [ 0.278469] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]265gitlab # [ 0.278518] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]266gitlab # [ 0.278540] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]267gitlab # [ 0.279566] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint268gitlab # [ 0.279994] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]269gitlab # [ 0.280010] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]270gitlab # [ 0.280049] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]271gitlab # [ 0.280973] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint272gitlab # [ 0.281286] pci 0000:00:03.0: BAR 0 [io 0x0000-0x001f]273gitlab # [ 0.281303] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]274gitlab # [ 0.281342] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]275gitlab # [ 0.282186] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint276gitlab # [ 0.282579] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]277gitlab # [ 0.282603] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]278gitlab # [ 0.282661] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]279gitlab # [ 0.283538] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint280gitlab # [ 0.283945] pci 0000:00:05.0: BAR 0 [io 0x0000-0x007f]281gitlab # [ 0.283968] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]282gitlab # [ 0.284027] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]283gitlab # [ 0.284910] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint284gitlab # [ 0.285328] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]285gitlab # [ 0.285345] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]286gitlab # [ 0.285385] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]287gitlab # [ 0.286273] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint288gitlab # [ 0.286694] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]289gitlab # [ 0.286711] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]290gitlab # [ 0.286750] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]291gitlab # [ 0.286772] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]292gitlab # [ 0.287684] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint293gitlab # [ 0.288045] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]294gitlab # [ 0.288091] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]295gitlab # [ 0.289024] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint296gitlab # [ 0.289428] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]297gitlab # [ 0.289473] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]298gitlab # [ 0.290194] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint299gitlab # [ 0.290584] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]300gitlab # [ 0.291044] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint301gitlab # [ 0.291465] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]302gitlab # [ 0.291483] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]303gitlab # [ 0.291542] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]304gitlab # [ 0.292403] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint305gitlab # [ 0.292800] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]306gitlab # [ 0.292818] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]307gitlab # [ 0.292861] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]308gitlab # [ 0.293852] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned309gitlab # [ 0.293861] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned310gitlab # [ 0.293867] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned311gitlab # [ 0.293930] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned312gitlab # [ 0.293994] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned313gitlab # [ 0.294066] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned314gitlab # [ 0.294129] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned315gitlab # [ 0.294195] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned316gitlab # [ 0.294265] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned317gitlab # [ 0.294330] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned318gitlab # [ 0.294400] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned319gitlab # [ 0.294472] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned320gitlab # [ 0.294555] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned321gitlab # [ 0.294618] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned322gitlab # [ 0.294644] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned323gitlab # [ 0.294669] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned324gitlab # [ 0.294695] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned325gitlab # [ 0.294721] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned326gitlab # [ 0.294748] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned327gitlab # [ 0.294775] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned328gitlab # [ 0.294801] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned329gitlab # [ 0.294834] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned330gitlab # [ 0.294860] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned331gitlab # [ 0.294887] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned332gitlab # [ 0.294920] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned333gitlab # [ 0.294946] pci 0000:00:05.0: BAR 0 [io 0x1000-0x107f]: assigned334gitlab # [ 0.294971] pci 0000:00:06.0: BAR 0 [io 0x1080-0x10ff]: assigned335gitlab # [ 0.294996] pci 0000:00:0b.0: BAR 0 [io 0x1100-0x113f]: assigned336gitlab # [ 0.295021] pci 0000:00:01.0: BAR 0 [io 0x1140-0x115f]: assigned337gitlab # [ 0.295048] pci 0000:00:02.0: BAR 0 [io 0x1160-0x117f]: assigned338gitlab # [ 0.295073] pci 0000:00:03.0: BAR 0 [io 0x1180-0x119f]: assigned339gitlab # [ 0.295099] pci 0000:00:04.0: BAR 0 [io 0x11a0-0x11bf]: assigned340gitlab # [ 0.295124] pci 0000:00:07.0: BAR 0 [io 0x11c0-0x11df]: assigned341gitlab # [ 0.295150] pci 0000:00:0c.0: BAR 0 [io 0x11e0-0x11ff]: assigned342gitlab # [ 0.295182] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]343gitlab # [ 0.295190] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]344gitlab # [ 0.295194] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]345gitlab # [ 0.297848] pci 0000:00:0a.0: enabling device (0000 -> 0002)346gitlab # [ 0.330825] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)347gitlab # [ 0.336557] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)348gitlab # [ 0.342741] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)349gitlab # [ 0.349061] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)350gitlab # [ 0.354972] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)351gitlab # [ 0.361248] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)352gitlab # [ 0.367362] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)353gitlab # [ 0.373763] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)354gitlab # [ 0.379780] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)355gitlab # [ 0.385630] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)356gitlab # [ 0.392390] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)357gitlab # [ 0.407566] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled358gitlab # [ 0.412522] msm_serial: driver initialized359gitlab # [ 0.413057] SuperH (H)SCI(F) driver initialized360gitlab # [ 0.413237] STM32 USART driver initialized361gitlab # [ 0.457084] loop: module loaded362gitlab # [ 0.457707] virtio_blk virtio4: 4/0/0 default/read/poll queues363gitlab # [ 0.462523] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)364gitlab # [ 0.466843] virtio_blk virtio5: 4/0/0 default/read/poll queues365gitlab # [ 0.470804] virtio_blk virtio5: [vdb] 12237880 512-byte logical blocks (6.27 GB/5.83 GiB)366gitlab # [ 0.475096] megasas: 07.734.00.00-rc1367gitlab # [ 0.476890] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]368gitlab # [ 0.481276] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000369gitlab # [ 0.481306] Intel/Sharp Extended Query Table at 0x0031370gitlab # [ 0.485560] Using buffer write method371gitlab # [ 0.485622] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]372gitlab # [ 0.490469] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000373gitlab # [ 0.490498] Intel/Sharp Extended Query Table at 0x0031374gitlab # [ 0.493551] Using buffer write method375gitlab # [ 0.493576] Concatenating MTD devices:376gitlab # [ 0.493581] (0): "0.flash"377gitlab # [ 0.493586] (1): "0.flash"378gitlab # [ 0.493591] into device "0.flash"379gitlab # [ 0.675672] Freeing initrd memory: 27184K380gitlab # [ 0.689725] tun: Universal TUN/TAP device driver, 1.6381gitlab # [ 0.694118] thunder_xcv, ver 1.0382gitlab # [ 0.694165] thunder_bgx, ver 1.0383gitlab # [ 0.694194] nicpf, ver 1.0384gitlab # [ 0.694907] e1000: Intel(R) PRO/1000 Network Driver385gitlab # [ 0.694912] e1000: Copyright (c) 1999-2006 Intel Corporation.386gitlab # [ 0.694940] e1000e: Intel(R) PRO/1000 Network Driver387gitlab # [ 0.694946] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.388gitlab # [ 0.694981] igb: Intel(R) Gigabit Ethernet Network Driver389gitlab # [ 0.694985] igb: Copyright (c) 2007-2014 Intel Corporation.390gitlab # [ 0.695016] igbvf: Intel(R) Gigabit Virtual Function Network Driver391gitlab # [ 0.695021] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.392gitlab # [ 0.695187] sky2: driver version 1.30393gitlab # [ 0.697178] usbcore: registered new interface driver usb-storage394gitlab # [ 0.697340] usbcore: registered new interface driver usbserial_generic395gitlab # [ 0.697358] usbserial: USB Serial support registered for generic396gitlab # [ 0.698023] ehci-pci 0000:00:0a.0: EHCI Host Controller397gitlab # [ 0.698101] hv_vmbus: registering driver hyperv_keyboard398gitlab # [ 0.698131] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1399gitlab # [ 0.698638] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000400gitlab # [ 0.699233] rtc-pl031 9010000.pl031: registered as rtc0401gitlab # [ 0.699260] rtc-pl031 9010000.pl031: setting system clock to 2026-08-29T13:39:07 UTC (1788010747)402gitlab # [ 0.699692] i2c_dev: i2c /dev entries driver403gitlab # [ 0.703175] sdhci: Secure Digital Host Controller Interface driver404gitlab # [ 0.703182] sdhci: Copyright(c) Pierre Ossman405gitlab # [ 0.703521] Synopsys Designware Multimedia Card Interface Driver406gitlab # [ 0.704002] sdhci-pltfm: SDHCI platform and OF driver helper407gitlab # [ 0.706017] hid: raw HID events driver (C) Jiri Kosina408gitlab # [ 0.706364] usbcore: registered new interface driver usbhid409gitlab # [ 0.706368] usbhid: USB HID core driver410gitlab # [ 0.708396] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00411gitlab # [ 0.709372] hub 1-0:1.0: USB hub found412gitlab # [ 0.709411] hub 1-0:1.0: 6 ports detected413gitlab # [ 0.713995] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available414gitlab # [ 0.716366] drop_monitor: Initializing network drop monitor service415gitlab # [ 0.716523] NET: Registered PF_INET6 protocol family416gitlab # [ 0.717694] Segment Routing with IPv6417gitlab # [ 0.717712] In-situ OAM (IOAM) with IPv6418gitlab # [ 0.717749] NET: Registered PF_PACKET protocol family419gitlab # [ 0.717979] 9pnet: Installing 9P2000 support420gitlab # [ 0.720278] Key type dns_resolver registered421gitlab # [ 0.729112] registered taskstats version 1422gitlab # [ 0.729378] Loading compiled-in X.509 certificates423gitlab # [ 0.740810] Demotion targets for Node 0: null424gitlab # [ 0.740948] Key type .fscrypt registered425gitlab # [ 0.740952] Key type fscrypt-provisioning registered426gitlab # [ 0.741068] ima: No TPM chip found, activating TPM-bypass!427gitlab # [ 0.741085] ima: Allocated hash algorithm: sha1428gitlab # [ 0.741106] ima: No architecture policies found429gitlab # [ 0.742003] input: gpio-keys as /devices/platform/gpio-keys/input/input0430gitlab # [ 0.760676] clk: Disabling unused clocks431gitlab # [ 0.760686] PM: genpd: Disabling unused power domains432gitlab # [ 0.764778] Freeing unused kernel memory: 4736K433gitlab # [ 0.764974] Run /init as init process434gitlab # [ 0.793752] systemd[1]: Successfully made /usr/ read-only.435gitlab # [ 0.956400] usb 1-1: new high-speed USB device number 2 using ehci-pci436gitlab # [ 1.110851] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1437gitlab # [ 1.128022] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)438gitlab # [ 1.128091] systemd[1]: Detected virtualization qemu.439gitlab # [ 1.128175] systemd[1]: Detected architecture arm64.440gitlab # [ 1.128192] systemd[1]: Running in initrd.441gitlab # [ 1.129143] systemd[1]: Initializing machine ID from random generator.442gitlab # [ 1.129405] systemd[1]: Hostname set to <gitlab>.443gitlab # [ 1.213093] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0444gitlab # [ 1.332416] usb 1-2: new high-speed USB device number 3 using ehci-pci445gitlab # [ 1.346736] systemd[1]: bpf-restrict-fs: LSM BPF program attached446gitlab # [ 1.431248] systemd[1]: Queued start job for default target Initrd Default Target.447gitlab # [ 1.448652] systemd[1]: Created slice Slice /system/modprobe.448gitlab # [ 1.448942] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.449gitlab # [ 1.448981] systemd[1]: Expecting device /dev/disk/by-label/nix-store...450gitlab # [ 1.448997] systemd[1]: Expecting device /dev/disk/by-label/nixos...451gitlab # [ 1.449024] systemd[1]: Reached target Path Units.452gitlab # [ 1.449044] systemd[1]: Reached target Slice Units.453gitlab # [ 1.449064] systemd[1]: Reached target Swaps.454gitlab # [ 1.449087] systemd[1]: Reached target Timer Units.455gitlab # [ 1.449282] systemd[1]: Listening on D-Bus System Message Bus Socket.456gitlab # [ 1.449483] systemd[1]: Listening on Journal Socket (/dev/log).457gitlab # [ 1.449667] systemd[1]: Listening on Journal Sockets.458gitlab # [ 1.449846] systemd[1]: Listening on udev Control Socket.459gitlab # [ 1.449953] systemd[1]: Listening on udev Kernel Socket.460gitlab # [ 1.449978] systemd[1]: Reached target Socket Units.461gitlab # [ 1.452011] systemd[1]: Starting Create List of Static Device Nodes...462gitlab # [ 1.454485] systemd[1]: Starting Load Kernel Module 9pnet_virtio...463gitlab # [ 1.454564] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs464gitlab # [ 1.460472] systemd[1]: Mounting Kernel Configuration File System...465gitlab # [ 1.480951] systemd[1]: Starting Journal Service...466gitlab # [ 1.488158] systemd[1]: Starting Load Kernel Modules...467gitlab # [ 1.488396] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os468gitlab # [ 1.492591] systemd[1]: Starting Coldplug All udev Devices...469gitlab # [ 1.495237] systemd[1]: Finished Create List of Static Device Nodes.470gitlab # [ 1.495749] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2471gitlab # [ 1.496117] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0472gitlab # [ 1.499050] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.473gitlab # [ 1.500033] systemd[1]: Finished Load Kernel Module 9pnet_virtio.474gitlab # [ 1.500768] systemd[1]: Mounted Kernel Configuration File System.475gitlab # [ 1.510705] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...476gitlab # [ 1.539333] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.477gitlab # [ 1.539406] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.478gitlab # [ 1.539645] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev479gitlab # [ 1.540810] systemd-journald[95]: Collecting audit messages is disabled.480gitlab # [ 1.545210] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0481gitlab # [ 1.545426] [drm] features: -virgl +edid -resource_blob -host_visible482gitlab # [ 1.545431] [drm] features: -context_init483gitlab # [ 1.546842] [drm] number of scanouts: 1484gitlab # [ 1.546861] [drm] number of cap sets: 0485gitlab # [ 1.548916] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic486gitlab # [ 1.548929] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0487gitlab # [ 1.556443] systemd[1]: Starting Create Static Device Nodes in /dev...488gitlab # [ 1.564687] Console: switching to colour frame buffer device 160x50489gitlab # [ 1.575627] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device490gitlab # [ 1.586478] systemd[1]: Finished Create Static Device Nodes in /dev.491gitlab # [ 1.587093] systemd[1]: Reached target Preparation for Local File Systems.492gitlab # [ 1.587565] systemd[1]: Reached target Local File Systems.493gitlab # [ 1.597437] systemd[1]: Starting Rule-based Manager for Device Events and Files...494gitlab # [ 1.603158] systemd[1]: Finished Load Kernel Modules.495gitlab # [ 1.601472] systemd-modules-load[96]: Using 4 probe threads496gitlab # [ 1.603727] systemd-modules-load[96]: Module 'virtio_balloon' is built in497gitlab # [ 1.604897] systemd-modules-load[96]: Module 'virtio_console' is built in498gitlab # [ 1.605936] systemd-modules-load[96]: Module 'virtio_rng' is built in499gitlab # [ 1.606914] systemd-modules-load[96]: Inserted module 'dm_mod'500gitlab # [ 1.607838] systemd-modules-load[96]: Inserted module 'virtio_gpu'501gitlab # [ 1.621300] systemd[1]: Starting Apply Kernel Variables...502gitlab # [ 1.623991] systemd[1]: Started Journal Service.503gitlab # [ 1.638097] systemd[1]: Starting Create System Files and Directories...504gitlab # [ 1.644347] systemd[1]: Finished Apply Kernel Variables.505gitlab # [ 1.655188] systemd[1]: Finished Create System Files and Directories.506gitlab # [ 1.656969] systemd-udevd[105]: Using default interface naming scheme 'v261'.507gitlab # [ 1.676491] systemd[1]: Started Rule-based Manager for Device Events and Files.508gitlab # [ 1.704147] systemd[1]: Starting Virtual Console Setup...509gitlab # [ 1.767319] systemd-vconsole-setup[131]: Configuration of first virtual console was skipped, ignoring remaining ones.510gitlab # [ 1.771364] systemd[1]: Finished Virtual Console Setup.511gitlab # [ 2.121020] systemd[1]: Finished Coldplug All udev Devices.512gitlab # [ 2.123652] systemd[1]: Reached target System Initialization.513gitlab # [ 2.126270] systemd[1]: Reached target Basic System.514gitlab # [ 2.322904] (udev-worker)[125]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.515gitlab # [ 2.330901] (udev-worker)[125]: Network interface NamePolicy= disabled on kernel command line.516gitlab # [ 2.341260] (udev-worker)[149]: Network interface NamePolicy= disabled on kernel command line.517gitlab # [ 2.360714] systemd[1]: Found device /dev/disk/by-label/nix-store.518gitlab # [ 2.380809] systemd[1]: Found device /dev/disk/by-label/nixos.519gitlab # [ 2.383741] systemd[1]: Reached target Initrd Root Device.520gitlab # [ 2.385668] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...521gitlab # [ 2.427875] systemd-fsck[154]: nixos: clean, 12/65536 files, 13019/262144 blocks522gitlab # [ 2.431872] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.523gitlab # [ 2.491360] systemd[1]: Mounting /sysroot...524gitlab # [ 2.523068] EXT4-fs (vda): mounted filesystem befa21e7-cf5b-4f46-a35d-4108897c4c63 r/w with ordered data mode. Quota mode: none.525gitlab # [ 2.522989] systemd[1]: Mounted /sysroot.526gitlab # [ 2.524699] systemd[1]: Reached target Initrd Root File System.527gitlab # [ 2.528215] systemd[1]: Mounting /sysroot/nix/.ro-store...528gitlab # [ 2.529993] systemd[1]: Mounting /sysroot/nix/.rw-store...529gitlab # [ 2.545404] systemd[1]: Mounting /sysroot/run...530gitlab # [ 2.553319] systemd[1]: Mounting /sysroot/tmp/shared...531gitlab # [ 2.565106] systemd[1]: Mounting /sysroot/tmp/xchg...532gitlab # [ 2.591999] systemd[1]: Starting Mountpoints Configured in the Real Root...533gitlab # [ 2.605971] systemd-sysroot-fstab-check[168]: /sysroot should be mounted in the initrd, will request daemon-reload.534gitlab # [ 2.609823] systemd[1]: Mounted /sysroot/nix/.rw-store.535gitlab # [ 2.612016] systemd[1]: Mounted /sysroot/run.536gitlab # [ 2.613974] systemd[1]: Mounted /sysroot/tmp/shared.537gitlab # [ 2.634774] systemd[1]: Starting rw-sysroot-nix-store.service...538gitlab # [ 2.636456] systemd[1]: Reload requested from client PID 168 ('systemd-sysroot') (unit initrd-parse-etc.service)...539gitlab # [ 2.641849] systemd[1]: Reloading...540gitlab # [ 2.795282] erofs (device vdb): mounted with root inode @ nid 128.541gitlab # [ 2.854218] systemd[1]: Reloading finished in 217 ms.542gitlab # [ 2.918087] systemd-sysroot-fstab-check[168]: Requesting initrd-fs.target/start/replace...543gitlab # [ 2.922347] systemd[1]: Mounted /sysroot/nix/.ro-store.544gitlab # [ 2.924153] systemd[1]: Mounted /sysroot/tmp/xchg.545gitlab # [ 2.924916] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.546gitlab # [ 2.925908] systemd[1]: Finished rw-sysroot-nix-store.service.547gitlab # [ 2.926996] systemd-sysroot-fstab-check[168]: Requesting swap.target/start/replace...548gitlab # [ 2.933462] systemd[1]: Starting rw-sysroot-nix-store.service...549gitlab # [ 2.934373] systemd[1]: initrd-parse-etc.service: Deactivated successfully.550gitlab # [ 2.935340] systemd[1]: Finished Mountpoints Configured in the Real Root.551gitlab # [ 2.936322] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.552gitlab # [ 2.955703] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.553gitlab # [ 2.957273] systemd[1]: Finished rw-sysroot-nix-store.service.554gitlab # [ 2.959937] systemd[1]: Mounting /sysroot/nix/store...555gitlab # [ 2.979229] (udev-worker)[144]: mtd0ro: Failed to find and pin callout binary "/nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/mtd_probe": No such file or directory556gitlab # [ 2.981956] (udev-worker)[144]: mtd0ro: /nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory557gitlab # [ 2.989334] systemd[1]: Mounted /sysroot/nix/store.558gitlab # [ 2.996815] systemd[1]: Reached target Initrd File Systems.559gitlab # [ 2.997895] systemd[1]: Starting Find NixOS closure...560gitlab # [ 2.999005] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...561gitlab # [ 3.000254] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.562gitlab # [ 3.001267] systemd[1]: Stopped Virtual Console Setup.563gitlab # [ 3.001996] systemd[1]: Stopping Virtual Console Setup...564gitlab # [ 3.002765] systemd[1]: Starting Virtual Console Setup...565gitlab # [ 3.027261] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.566gitlab # [ 3.034312] systemd-vconsole-setup[205]: Configuration of first virtual console was skipped, ignoring remaining ones.567gitlab # [ 3.036179] systemd[1]: Finished Virtual Console Setup.568gitlab # [ 3.037504] systemd[1]: Finished Find NixOS closure.569gitlab # [ 3.038218] systemd[1]: Reached target Initrd Default Target.570gitlab # [ 3.039357] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...571gitlab # [ 3.056971] systemd[1]: Stopped target Initrd Default Target.572gitlab # [ 3.058060] systemd[1]: Stopped target Basic System.573gitlab # [ 3.058947] systemd[1]: Stopped target Initrd Root Device.574gitlab # [ 3.059919] systemd[1]: Stopped target Path Units.575gitlab # [ 3.060869] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.576gitlab # [ 3.062172] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.577gitlab # [ 3.063522] systemd[1]: Stopped target Slice Units.578gitlab # [ 3.064632] systemd[1]: Stopped target Socket Units.579gitlab # [ 3.065522] systemd[1]: Stopped target System Initialization.580gitlab # [ 3.067520] systemd[1]: Stopped target Swaps.581gitlab # [ 3.069133] systemd[1]: Stopped target Timer Units.582gitlab # [ 3.070993] systemd[1]: dbus.socket: Deactivated successfully.583gitlab # [ 3.072093] systemd[1]: Closed D-Bus System Message Bus Socket.584gitlab # [ 3.074165] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.585gitlab # [ 3.075437] systemd[1]: Stopped Find NixOS closure.586gitlab # [ 3.076354] systemd[1]: Starting Load Kernel Module 9pnet_virtio...587gitlab # [ 3.077328] systemd[1]: Starting rw-sysroot-nix-store.service...588gitlab # [ 3.078279] systemd[1]: systemd-sysctl.service: Deactivated successfully.589gitlab # [ 3.079330] systemd[1]: Stopped Apply Kernel Variables.590gitlab # [ 3.080158] systemd[1]: systemd-modules-load.service: Deactivated successfully.591gitlab # [ 3.081231] systemd[1]: Stopped Load Kernel Modules.592gitlab # [ 3.081997] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.593gitlab # [ 3.083179] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.594gitlab # [ 3.084496] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.595gitlab # [ 3.085592] systemd[1]: Stopped Create System Files and Directories.596gitlab # [ 3.086658] systemd[1]: Stopped target Local File Systems.597gitlab # [ 3.087582] systemd[1]: Stopped target Preparation for Local File Systems.598gitlab # [ 3.088603] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.599gitlab # [ 3.089616] systemd[1]: Stopped Coldplug All udev Devices.600gitlab # [ 3.090407] systemd[1]: Stopping Rule-based Manager for Device Events and Files...601gitlab # [ 3.091501] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.602gitlab # [ 3.092620] systemd[1]: Stopped Virtual Console Setup.603gitlab # [ 3.093397] systemd[1]: initrd-cleanup.service: Deactivated successfully.604gitlab # [ 3.094395] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.605gitlab # [ 3.095388] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.606gitlab # [ 3.096470] systemd[1]: Finished rw-sysroot-nix-store.service.607gitlab # [ 3.097270] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.608gitlab # [ 3.098250] systemd[1]: Finished Load Kernel Module 9pnet_virtio.609gitlab # [ 3.099112] systemd[1]: systemd-udevd.service: Deactivated successfully.610gitlab # [ 3.100035] systemd[1]: Stopped Rule-based Manager for Device Events and Files.611gitlab # [ 3.101034] systemd[1]: systemd-udevd.service: Consumed 2.396s CPU time over 1.503s wall clock time, 31.8M memory peak.612gitlab # [ 3.102429] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.613gitlab # [ 3.103410] systemd[1]: Closed udev Control Socket.614gitlab # [ 3.104140] systemd[1]: Starting Cleanup udev Database...615gitlab # [ 3.104891] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.616gitlab # [ 3.105922] systemd[1]: Stopped Create Static Device Nodes in /dev.617gitlab # [ 3.106782] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.618gitlab # [ 3.107989] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.619gitlab # [ 3.109094] systemd[1]: kmod-static-nodes.service: Deactivated successfully.620gitlab # [ 3.110046] systemd[1]: Stopped Create List of Static Device Nodes.621gitlab # [ 3.160634] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.622gitlab # [ 3.162652] systemd[1]: Finished Cleanup udev Database.623gitlab # [ 3.164109] systemd[1]: Reached target Switch Root.624gitlab # [ 3.166389] systemd[1]: Starting NixOS Activation...625gitlab # [ 3.331665] initrd-nixos-activation-start[225]: booting system configuration /nix/store/nqm4dkvrqgia6mhfac4wglpnflj8av0m-nixos-system-gitlab-test626gitlab # [ 3.393741] initrd-nixos-activation-start[225]: running activation script...627gitlab # [ 3.714816] initrd-nixos-activation-start[248]: setting up /etc...628gitlab # [ 3.883493] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.629gitlab # [ 3.887019] systemd[1]: Finished NixOS Activation.630gitlab # [ 3.889402] systemd[1]: Starting Switch Root...631gitlab # [ 3.938598] systemd[1]: Switching root.632gitlab # [ 4.076939] systemd-journald[95]: Received SIGTERM from PID 1 (systemd).633gitlab # [ 4.697916] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)634gitlab # [ 4.698061] systemd[1]: Detected virtualization qemu.635gitlab # [ 4.698167] systemd[1]: Detected architecture arm64.636gitlab # [ 4.698357] systemd[1]: Detected first boot.637gitlab # [ 4.699773] systemd[1]: Initializing machine ID from random generator.638gitlab # [ 4.948767] systemd[1]: bpf-restrict-fs: LSM BPF program attached639gitlab # [ 5.069415] systemd[1]: Applying preset policy.640gitlab # [ 5.309786] systemd[1]: Populated /etc with preset unit settings.641gitlab # [ 5.458149] systemd[1]: initrd-switch-root.service: Deactivated successfully.642gitlab # [ 5.458573] systemd[1]: Stopped initrd-switch-root.service.643gitlab # [ 5.461068] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.644gitlab # [ 5.466530] systemd[1]: Created slice Slice /system/getty.645gitlab # [ 5.473089] systemd[1]: Created slice GitLab DevOps Platform Slice.646gitlab # [ 5.477659] systemd[1]: Created slice User and Session Slice.647gitlab # [ 5.478938] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.648gitlab # [ 5.479917] systemd[1]: Started Forward Password Requests to Wall Directory Watch.649gitlab # [ 5.480941] systemd[1]: Expecting device /dev/hvc0...650gitlab # [ 5.482003] systemd[1]: Expecting device /dev/ttyAMA0...651gitlab # [ 5.483073] systemd[1]: Reached target Local Encrypted Volumes.652gitlab # [ 5.484178] systemd[1]: Stopped target initrd-fs.target.653gitlab # [ 5.485263] systemd[1]: Stopped target initrd-root-fs.target.654gitlab # [ 5.486315] systemd[1]: Stopped target initrd-switch-root.target.655gitlab # [ 5.487407] systemd[1]: Reached target Virtual Machines and Containers.656gitlab # [ 5.488650] systemd[1]: Reached target Path Units.657gitlab # [ 5.489563] systemd[1]: Reached target Remote File Systems.658gitlab # [ 5.490223] systemd[1]: Reached target Slice Units.659gitlab # [ 5.490868] systemd[1]: Reached target Swaps.660gitlab # [ 5.494745] systemd[1]: Listening on Query the User Interactively for a Password.661gitlab # [ 5.498825] systemd[1]: Listening on Process Core Dump Socket.662gitlab # [ 5.501951] systemd[1]: Listening on Credential Encryption/Decryption.663gitlab # [ 5.505664] systemd[1]: Listening on Factory Reset Management.664gitlab # [ 5.506998] systemd[1]: Listening on Hostname Service Socket.665gitlab # [ 5.517025] systemd[1]: Starting Journal Log Access Socket...666gitlab # [ 5.519225] systemd[1]: Listening on Journal Audit Socket.667gitlab # [ 5.523487] systemd[1]: Listening on Console Output Muting Service Socket.668gitlab # [ 5.525154] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.669gitlab # [ 5.526330] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os670gitlab # [ 5.527378] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki671gitlab # [ 5.533833] systemd[1]: Listening on Disk Repartitioning Service Socket.672gitlab # [ 5.535195] systemd[1]: Listening on udev Control Socket.673gitlab # [ 5.536642] systemd[1]: Listening on udev Varlink Socket.674gitlab # [ 5.544087] systemd[1]: Mounting Huge Pages File System...675gitlab # [ 5.553629] systemd[1]: Mounting POSIX Message Queue File System...676gitlab # [ 5.565039] systemd[1]: Mounting Kernel Debug File System...677gitlab # [ 5.573488] systemd[1]: Mounting Kernel Trace File System...678gitlab # [ 5.580557] systemd[1]: Starting Create List of Static Device Nodes...679gitlab # [ 5.597036] systemd[1]: Starting Load Kernel Module 9pnet_virtio...680gitlab # [ 5.600500] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs681gitlab # [ 5.608564] systemd[1]: Mounting Kernel Configuration File System...682gitlab # [ 5.609376] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm683gitlab # [ 5.610098] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore684gitlab # [ 5.620505] systemd[1]: Starting Load Kernel Module fuse...685gitlab # [ 5.621300] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67686gitlab # [ 5.629662] systemd[1]: Starting Journal Service...687gitlab # [ 5.635160] systemd[1]: Starting Load Kernel Modules...688gitlab # [ 5.644082] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...689gitlab # [ 5.656504] systemd[1]: Starting Remount Root and Kernel File Systems...690gitlab # [ 5.657330] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os691gitlab # [ 5.660475] fuse: init (API version 7.45)692gitlab # [ 5.672547] systemd[1]: Starting Coldplug All udev Devices...693gitlab # [ 5.677539] systemd[1]: Listening on Journal Log Access Socket.694gitlab # [ 5.678267] systemd[1]: Mounted Huge Pages File System.695gitlab # [ 5.679065] systemd[1]: Mounted POSIX Message Queue File System.696gitlab # [ 5.679790] systemd[1]: Mounted Kernel Debug File System.697gitlab # [ 5.682141] systemd[1]: Mounted Kernel Trace File System.698gitlab # [ 5.685553] systemd[1]: Finished Create List of Static Device Nodes.699gitlab # [ 5.688170] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.700gitlab # [ 5.689188] systemd[1]: Finished Load Kernel Module 9pnet_virtio.701gitlab # [ 5.690062] systemd[1]: Mounted Kernel Configuration File System.702gitlab # [ 5.691031] systemd[1]: modprobe@fuse.service: Deactivated successfully.703gitlab # [ 5.692016] systemd[1]: Finished Load Kernel Module fuse.704gitlab # [ 5.693191] systemd[1]: Finished Load Kernel Modules.705gitlab # [ 5.693277] systemd-journald[319]: Collecting audit messages is enabled.706gitlab # [ 5.699291] systemd[1]: Queued start job for default target Multi-User System.[ 5.700591] EXT4-fs (vda): re-mounted befa21e7-cf5b-4f46-a35d-4108897c4c63.707gitlab # 708gitlab # [ 5.710317] systemd[1]: Unnecessary job was removed for /dev/vdb.709gitlab # [ 5.711630] systemd[1]: systemd-journald.service: Deactivated successfully.710gitlab # [ 5.717078] systemd[1]: Mounting FUSE Control File System...711gitlab # [ 5.714581] systemd-modules-load[320]: Using 3 probe threads712gitlab # [ 5.716584] systemd-modules-load[320]: Module 'atkbd' is built in713gitlab # [ 5.717769] systemd-modules-load[320]: Module 'loop' is built in[ 5.722862] systemd[1]: Starting Firewall...714gitlab # 715gitlab # [ 5.720761] systemd-modules-load[320]: Inserted module 'tls'716gitlab # [ 5.739217] systemd[1]: Starting Apply Kernel Variables...717gitlab # [ 5.739249] systemd-oomd[321]: No swap; memory pressure usage will be degraded718gitlab # [ 5.745188] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...719gitlab # [ 5.752589] systemd[1]: Started Journal Service.720gitlab # [ 5.749915] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.721gitlab # [ 5.752524] systemd[1]: Finished Remount Root and Kernel File Systems.722gitlab # [ 5.755512] systemd[1]: Mounted FUSE Control File System.723gitlab # [ 5.765877] systemd[1]: Listening on Disk Image Download Service Socket.724gitlab # [ 5.768001] systemd[1]: Starting Flush Journal to Persistent Storage...725gitlab # [ 5.775634] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore726gitlab # [ 5.784858] systemd-journald[319]: Received client request to flush runtime journal.727gitlab # [ 5.818614] systemd[1]: Starting Load/Save OS Random Seed...728gitlab # [ 5.819823] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os729gitlab # [ 5.821466] systemd[1]: Finished Apply Kernel Variables.730gitlab # [ 5.823016] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.731gitlab # [ 5.824239] systemd[1]: Starting Create Static Device Nodes in /dev...732gitlab # [ 5.825504] systemd[1]: Finished Load/Save OS Random Seed.733gitlab # [ 5.826345] systemd[1]: Reached target First Boot Complete.734gitlab # [ 5.827190] systemd[1]: Finished Flush Journal to Persistent Storage.735gitlab # [ 5.837925] systemd[1]: Finished Create Static Device Nodes in /dev.736gitlab # [ 5.838942] systemd[1]: Reached target Preparation for Local File Systems.737gitlab # [ 5.841405] systemd[1]: Starting Rule-based Manager for Device Events and Files...738gitlab # [ 5.917913] systemd-udevd[376]: Using default interface naming scheme 'v261'.739gitlab # [ 5.957358] systemd[1]: Started Rule-based Manager for Device Events and Files.740gitlab # [ 6.164428] systemd[1]: Finished Firewall.741gitlab # [ 6.323197] systemd[1]: Finished Coldplug All udev Devices.742gitlab # [ 6.396593] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs743gitlab # [ 6.470229] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.744gitlab # [ 6.475739] systemd[1]: Mounting /run/wrappers...745gitlab # [ 6.494694] (udev-worker)[427]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.746gitlab # [ 6.499879] (udev-worker)[427]: Network interface NamePolicy= disabled on kernel command line.747gitlab # [ 6.510278] (udev-worker)[474]: Network interface NamePolicy= disabled on kernel command line.748gitlab # [ 6.512481] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped.749gitlab # [ 6.529892] systemd[1]: Mounted /run/wrappers.750gitlab # [ 6.535498] systemd[1]: Reached target Local File Systems.751gitlab # [ 6.536996] systemd[1]: Listening on Boot Loader Control Service Socket.752gitlab # [ 6.541490] systemd[1]: Starting register-nix-paths.service...753gitlab # [ 6.547447] systemd[1]: Starting Create SUID/SGID Wrappers...754gitlab # [ 6.548460] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.755gitlab # [ 6.549754] systemd[1]: Starting Save Transient machine-id to Disk...756gitlab # [ 6.566058] systemd[1]: Starting Create System Files and Directories...757gitlab # [ 6.568259] systemd[1]: Condition check resulted in Virtio network device being skipped.758gitlab # [ 6.569843] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore759gitlab # [ 6.573483] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.760gitlab # [ 6.575133] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67761gitlab # [ 6.581343] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore762gitlab # [ 6.583040] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os763gitlab # [ 6.585036] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os764gitlab # [ 6.610926] mousedev: PS/2 mouse device common for all mice765gitlab # [ 6.608820] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.766gitlab # [ 6.614351] systemd[1]: Finished Save Transient machine-id to Disk.767gitlab # [ 6.622406] systemd[1]: Finished Create System Files and Directories.768gitlab # [ 6.625610] systemd[1]: Starting Rebuild Journal Catalog...769gitlab # [ 6.628535] systemd[1]: Starting Record System Boot/Shutdown in UTMP...770gitlab # [ 6.660790] systemd[1]: Finished Record System Boot/Shutdown in UTMP.771gitlab # [ 6.674030] systemd[1]: Finished Rebuild Journal Catalog.772gitlab # [ 6.676429] systemd[1]: Starting Update is Completed...773gitlab # [ 6.706689] systemd[1]: Finished Update is Completed.774gitlab # [ 6.746998] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.775gitlab # [ 6.748254] systemd[1]: Finished Create SUID/SGID Wrappers.776gitlab # [ 6.749238] systemd[1]: suid-sgid-wrappers.service: Consumed 140ms CPU time over 202ms wall clock time, 7.1M memory peak, 1.9M read from disk.777gitlab # [ 7.012124] systemd[1]: Finished register-nix-paths.service.778gitlab # [ 7.013913] systemd[1]: Reached target System Initialization.779gitlab # [ 7.016146] systemd[1]: Started Discard unused filesystem blocks once a week.780gitlab # [ 7.017228] systemd[1]: Started logrotate.timer.781gitlab # [ 7.019222] systemd[1]: Started Daily Cleanup of Temporary Directories.782gitlab # [ 7.021696] systemd[1]: Reached target Timer Units.783gitlab # [ 7.025919] systemd[1]: Listening on D-Bus System Message Bus Socket.784gitlab # [ 7.026954] systemd[1]: Listening on Nix Daemon Socket.785gitlab # [ 7.029430] systemd[1]: Starting nixbot CI service socket...786gitlab # [ 7.032088] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.787gitlab # [ 7.036778] systemd[1]: Starting D-Bus System Message Bus...788gitlab # [ 7.037700] systemd[1]: Listening on nixbot CI service socket.789gitlab # [ 7.038546] systemd[1]: Reached target Socket Units.790gitlab # [ 7.073930] dbus-broker-launch[565]: Looking up NSS user entry for 'systemd-timesync'...791gitlab # [ 7.076104] dbus-broker-launch[565]: NSS returned no entry for 'systemd-timesync'792gitlab # [ 7.077259] dbus-broker-launch[565]: Invalid user-name in /nix/store/9zcyylhndlnizbwn48627991zr1jxg4p-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"793gitlab # [ 7.081623] systemd[1]: Started D-Bus System Message Bus.794gitlab # [ 7.095036] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3795gitlab # [ 7.097478] dbus-broker-launch[565]: Ready796gitlab # [ 7.098676] systemd[1]: Reached target Basic System.797gitlab # [ 7.110010] systemd[1]: Started backdoor.service.798gitlab # [ 7.113182] systemd[1]: Starting gitlab-config.service...799gitlab # [ 7.130014] systemd[1]: Starting Import lastlog data into lastlog2 database...800gitlab # [ 7.152434] systemd[1]: Starting Logrotate configuration check...801gitlab # connecting to host...802gitlab # [ 7.160394] systemd[1]: Starting Name Service Cache Daemon (nsncd)...803gitlab # [ 7.165841] systemd[1]: Starting Post-Boot Actions...804gitlab: Guest shell says: b'Spawning backdoor root shell...\n'805gitlab # [ 7.174176] systemd[1]: Started Reset console on configuration changes.806gitlab # [ 7.178536] logrotate[577]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.807gitlab: connected to guest root shell808gitlab # [ 7.181114] logrotate[577]: reading config file /nix/store/22afkmbkaxyx50bj9lbkkpmz7pd69hsf-logrotate.conf809gitlab: (connecting took 7.62 seconds)810gitlab # [ 7.182540] logrotate[577]: note: 'monthly' overrides previously specified 'weekly'811gitlab: (finished: waiting for the VM to finish booting, in 7.62 seconds)812gitlab # [ 7.183590] logrotate[577]: Reading state from file: /var/lib/logrotate.status813gitlab # [ 7.186141] logrotate[577]: state file /var/lib/logrotate.status does not exist814gitlab # [ 7.187275] logrotate[577]: Allocating hash table for state file, size 64 entries815gitlab # [ 7.191555] logrotate[577]: Handling 4 logs816gitlab # [ 7.192236] logrotate[577]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed817gitlab # [ 7.194446] logrotate[577]: considering log /var/log/btmp818gitlab # [ 7.196834] logrotate[577]: Creating new state819gitlab # [ 7.197497] logrotate[577]: Now: 2026-08-29 13:39820gitlab # [ 7.198189] logrotate[577]: Last rotated at 2026-08-29 13:00821gitlab # [ 7.198995] logrotate[577]: log does not need rotating (log has already been rotated)822gitlab # [ 7.201843] logrotate[577]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed823gitlab # [ 7.204177] logrotate[577]: considering log /var/log/wtmp824gitlab # [ 7.204943] logrotate[577]: Creating new state825gitlab # [ 7.205580] logrotate[577]: Now: 2026-08-29 13:39826gitlab # [ 7.206331] logrotate[577]: Last rotated at 2026-08-29 13:00827gitlab # [ 7.207160] logrotate[577]: log does not need rotating (log has already been rotated)828gitlab # [ 7.209006] logrotate[577]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed829gitlab # [ 7.210961] logrotate[577]: switching euid from 0 to 165 and egid from 0 to 165 (pid 577)830gitlab # [ 7.212131] logrotate[577]: considering log /var/gitlab/state/log/*.log831gitlab # [ 7.213040] logrotate[577]: log /var/gitlab/state/log/*.log does not exist -- skipping832gitlab # [ 7.214138] logrotate[577]: Creating new state833gitlab # [ 7.214767] logrotate[577]: switching euid from 165 to 0 and egid from 165 to 0 (pid 577)834gitlab # [ 7.215874] logrotate[577]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed835gitlab # [ 7.217772] logrotate[577]: switching euid from 0 to 60 and egid from 0 to 60 (pid 577)836gitlab # [ 7.218857] logrotate[577]: considering log /var/log/nginx/*.log837gitlab # [ 7.219702] logrotate[577]: log /var/log/nginx/*.log does not exist -- skipping838gitlab # [ 7.221677] logrotate[577]: Creating new state839gitlab # [ 7.222344] logrotate[577]: not running postrotate script, since no logs were rotated840gitlab # [ 7.223414] logrotate[577]: switching euid from 60 to 0 and egid from 60 to 0 (pid 577)841gitlab # [ 7.225092] nsncd[578]: Aug 29 13:39:14.005 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"842gitlab # [ 7.227312] systemd[1]: Starting resolvconf update...843gitlab # [ 7.229054] systemd[1]: Finished Logrotate configuration check.844gitlab # [ 7.230093] systemd[1]: Finished Post-Boot Actions.845gitlab # [ 7.230947] systemd[1]: Started Name Service Cache Daemon (nsncd).846gitlab # [ 7.231848] systemd[1]: Finished Import lastlog data into lastlog2 database.847gitlab # [ 7.232911] systemd[1]: Reached target Host and Network Name Lookups.848gitlab # [ 7.233816] systemd[1]: Reached target User and Group Name Lookups.849gitlab # [ 7.243617] systemd[1]: Starting User Login Management...850gitlab # [ 7.246592] systemd[1]: Starting Virtual Console Setup...851gitlab # [ 7.271475] systemd[1]: Stopped target Host and Network Name Lookups.852gitlab # [ 7.272689] systemd[1]: Stopping Host and Network Name Lookups...853gitlab # [ 7.273724] systemd[1]: Stopped target User and Group Name Lookups.854gitlab # [ 7.274863] systemd[1]: Stopping User and Group Name Lookups...855gitlab # [ 7.276510] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...856gitlab # [ 7.277600] systemd[1]: nscd.service: Deactivated successfully.857gitlab # [ 7.278413] systemd[1]: Stopped Name Service Cache Daemon (nsncd).858gitlab # [ 7.279391] systemd[1]: nscd.service: Consumed 25ms CPU time over 114ms wall clock time, 7.6M memory peak, 5.8M read from disk.859gitlab # [ 7.284568] systemd[1]: Starting Name Service Cache Daemon (nsncd)...860gitlab # [ 7.294744] systemd-logind[633]: New seat seat0.861gitlab # [ 7.298721] systemd-logind[633]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)862gitlab # [ 7.302294] systemd-logind[633]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)863gitlab # [ 7.303601] systemd-logind[633]: Watching system buttons on /dev/input/event0 (gpio-keys)864gitlab # [ 7.306846] systemd[1]: Started User Login Management.865gitlab # [ 7.307932] systemd[1]: Starting linger-users.service...866gitlab # [ 7.319342] systemd-vconsole-setup[635]: Configuration of first virtual console was skipped, ignoring remaining ones.867gitlab # [ 7.324634] nsncd[665]: Aug 29 13:39:14.127 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"868gitlab # [ 7.326729] systemd[1]: Finished Virtual Console Setup.869gitlab # [ 7.327484] systemd[1]: Started Name Service Cache Daemon (nsncd).870gitlab # [ 7.328574] systemd[1]: Finished resolvconf update.871gitlab # [ 7.329287] systemd[1]: linger-users.service: Deactivated successfully.872gitlab # [ 7.330236] systemd[1]: Finished linger-users.service.873gitlab # [ 7.330946] systemd[1]: Reached target Preparation for Network.874gitlab # [ 7.331854] systemd[1]: Reached target Host and Network Name Lookups.875gitlab # [ 7.332824] systemd[1]: Reached target User and Group Name Lookups.876gitlab # [ 7.334316] systemd[1]: Starting DHCP Client...877gitlab # [ 7.336799] systemd[1]: Starting Address configuration of eth1...878gitlab # [ 7.340479] systemd[1]: Starting Extra networking commands....879gitlab # [ 7.391150] network-addresses-eth1-start[695]: adding address 192.168.1.1/24... done880gitlab # [ 7.394562] network-addresses-eth1-start[695]: adding address 2001:db8:1::1/64... done881gitlab # [ 7.401139] systemd[1]: Finished Address configuration of eth1.882gitlab # [ 7.430551] dhcpcd[703]: dhcpcd-10.3.2 starting883gitlab # [ 7.432914] dhcpcd[755]: dev: loaded udev884gitlab # [ 7.439543] systemd[1]: Finished Extra networking commands..885gitlab # [ 7.440863] systemd[1]: Reached target Network.886gitlab # [ 7.443036] systemd[1]: Starting gitlab-workhorse.service...887gitlab # [ 7.446242] systemd[1]: Starting Nginx Web Server...888gitlab # [ 7.452382] 8021q: 802.1Q VLAN Support v1.8889gitlab # [ 7.452776] 8021q: adding VLAN 0 to HW filter on device eth1890gitlab # [ 7.452921] systemd[1]: Starting PostgreSQL Server...891gitlab # [ 7.457997] systemd[1]: Starting Redis Server - redis-gitlab...892gitlab # [ 7.462179] systemd[1]: Starting Permit User Sessions...893gitlab # [ 7.472119] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.894gitlab # [ 7.490823] systemd[1]: Finished Permit User Sessions.895gitlab # [ 7.492319] systemd[1]: Started Getty on tty1.896gitlab # [ 7.494648] systemd[1]: Reached target Login Prompts.897gitlab # [ 7.499599] cfg80211: Loading compiled-in X.509 certificates for regulatory database898gitlab # [ 7.508254] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'899gitlab # [ 7.508915] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'900gitlab # [ 7.511149] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2901gitlab # [ 7.511488] cfg80211: failed to load regulatory.db902gitlab # [ 7.560851] 8021q: adding VLAN 0 to HW filter on device eth0903gitlab # [ 7.557906] dhcpcd[755]: eth0: waiting for carrier904gitlab # [ 7.559686] dhcpcd[755]: eth0: carrier acquired905gitlab # [ 7.564047] dhcpcd[755]: DUID 00:01:00:01:32:25:9d:82:52:54:00:12:34:56906gitlab # [ 7.565084] dhcpcd[755]: eth0: IAID 00:12:34:56907gitlab # [ 7.565739] dhcpcd[755]: eth0: adding address fe80::5054:ff:fe12:3456908gitlab # [ 7.608296] nginx-pre-start[792]: nginx: the configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf syntax is ok909gitlab # [ 7.610167] nginx-pre-start[792]: nginx: configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf test is successful910gitlab # [ 7.613409] systemd[1]: Started Nginx Web Server.911gitlab # [ 7.632197] redis-server[789]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.912gitlab # [ 7.634682] redis-server[789]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo913gitlab # [ 7.636461] redis-server[789]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=789, just started914gitlab # [ 7.638383] systemd[1]: Started Redis Server - redis-gitlab.915gitlab # [ 7.639451] redis-server[789]: Configuration loaded916gitlab # [ 7.640845] redis[789]: monotonic clock: ARM CNTVCT @ 1000 ticks/us917gitlab # [ 7.641942] redis[789]: Running mode=standalone, port=0.918gitlab # [ 7.643184] redis[789]: Server initialized919gitlab # [ 7.644107] redis[789]: Ready to accept connections unix920gitlab # [ 7.645261] redis[789]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.921gitlab # [ 7.659371] postgresql-pre-start[799]: The files belonging to this database system will be owned by user "postgres".922gitlab # [ 7.661953] postgresql-pre-start[799]: This user must also own the server process.923gitlab # [ 7.663079] postgresql-pre-start[799]: The database cluster will be initialized with locale "en_US.UTF-8".924gitlab # [ 7.667249] postgresql-pre-start[799]: The default database encoding has accordingly been set to "UTF8".925gitlab # [ 7.669796] postgresql-pre-start[799]: The default text search configuration will be set to "english".926gitlab # [ 7.671120] postgresql-pre-start[799]: Data page checksums are enabled.927gitlab # [ 7.672149] postgresql-pre-start[799]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok928gitlab # [ 7.673553] postgresql-pre-start[799]: creating subdirectories ... ok929gitlab # [ 7.674385] postgresql-pre-start[799]: selecting dynamic shared memory implementation ... posix930gitlab # [ 7.700375] postgresql-pre-start[799]: selecting default "max_connections" ... 100931gitlab # [ 7.748213] postgresql-pre-start[799]: selecting default "shared_buffers" ... 128MB932gitlab # [ 8.048403] systemd[1]: Started gitlab-workhorse.service.933gitlab # [ 8.260584] postgresql-pre-start[799]: selecting default time zone ... UTC934gitlab # [ 8.264115] postgresql-pre-start[799]: creating configuration files ... ok935gitlab # [ 8.306147] gitlab-workhorse[822]: time="2026-08-29T13:39:15Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4936gitlab # [ 8.310726] gitlab-workhorse[822]: time="2026-08-29T13:39:15Z" level=info msg="Using redis/go-redis"937gitlab # [ 8.314660] gitlab-workhorse[822]: time="2026-08-29T13:39:15Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix938gitlab # [ 8.497244] postgresql-pre-start[799]: running bootstrap script ... ok939gitlab # [ 9.241802] postgresql-pre-start[799]: performing post-bootstrap initialization ... ok940gitlab # [ 9.415747] dhcpcd[755]: eth0: soliciting a DHCP lease941gitlab # [ 9.429020] dhcpcd[755]: eth0: offered 10.0.2.15 from 10.0.2.2942gitlab # [ 9.444389] dhcpcd[755]: eth0: probing address 10.0.2.15/24943gitlab # [ 9.476582] dhcpcd[755]: eth0: soliciting an IPv6 router944gitlab # [ 9.479495] dhcpcd[755]: eth0: Router Advertisement from fe80::2945gitlab # [ 9.482977] dhcpcd[755]: eth0: adding address fec0::5054:ff:fe12:3456/64946gitlab # [ 9.486583] dhcpcd[755]: eth0: adding route to fec0::/64947gitlab # [ 9.489515] dhcpcd[755]: eth0: adding default route via fe80::2948gitlab # [ 9.492298] postgresql-pre-start[799]: syncing data to disk ... ok949gitlab # [ 9.494859] postgresql-pre-start[799]: initdb: warning: enabling "trust" authentication for local connections950gitlab # [ 9.498958] postgresql-pre-start[799]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.951gitlab # [ 9.505732] postgresql-pre-start[799]: Success. You can now start the database server using:952gitlab # [ 9.509580] postgresql-pre-start[799]: pg_ctl -D /var/lib/postgresql/18 -l logfile start953gitlab # [ 9.691067] postgres[856]: [856] LOG: starting PostgreSQL 18.4 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit954gitlab # [ 9.697356] postgres[856]: [856] LOG: listening on IPv6 address "::1", port 5432955gitlab # [ 9.700971] postgres[856]: [856] LOG: listening on IPv4 address "127.0.0.1", port 5432956gitlab # [ 9.705023] postgres[856]: [856] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"957gitlab # [ 9.725069] postgres[866]: [866] LOG: database system was shut down at 2026-08-29 13:39:16 GMT958gitlab # [ 9.743711] postgres[856]: [856] LOG: database system is ready to accept connections959gitlab # [ 9.750501] systemd[1]: Started PostgreSQL Server.960gitlab # [ 9.760498] systemd[1]: Starting PostgreSQL Setup Scripts...961gitlab # [ 9.976614] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[874]: mkdir -p /var/gitlab/state/home/.ssh: OK962gitlab # [ 9.980748] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[874]: chmod 700 /var/gitlab/state/home/.ssh: OK963gitlab # [ 10.076342] systemd[1]: Finished gitlab-config.service.964gitlab # [ 10.080528] systemd[1]: Started gitaly.service.965gitlab # [ 10.149602] postgresql-setup-start[882]: CREATE DATABASE966gitlab # [ 10.206466] postgresql-setup-start[901]: CREATE ROLE967gitlab # [ 10.231406] postgresql-setup-start[903]: ALTER DATABASE968gitlab # [ 10.282790] postgresql-setup-start[908]: CREATE ROLE969gitlab # [ 10.289043] systemd[1]: Finished PostgreSQL Setup Scripts.970gitlab # [ 10.291728] systemd[1]: Reached target PostgreSQL.971gitlab # [ 10.296174] systemd[1]: Starting gitlab-db-config.service...972gitlab # [ 10.303509] systemd[1]: Starting gitlab-postgresql.service...973gitlab # [ 10.493906] gitlab-postgresql-start[924]: CREATE DATABASE974gitlab # [ 10.542551] gitlab-postgresql-start[938]: CREATE EXTENSION975gitlab # [ 10.634282] gitlab-postgresql-start[940]: CREATE EXTENSION976gitlab # [ 10.642761] systemd[1]: Finished gitlab-postgresql.service.977gitlab # [ 10.808611] gitaly[896]: time="2026-08-29T13:39:17.608Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/0r0qd84zrxhqq373hk9spv8j9pg0qlnq-gitaly.toml' and fix the errors that are printed." pid=896978gitlab # [ 10.824637] gitaly[896]: time="2026-08-29T13:39:17.609Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=896979gitlab # [ 10.833079] gitaly[896]: time="2026-08-29T13:39:17.609Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=896980gitlab # [ 10.835278] gitaly[896]: time="2026-08-29T13:39:17.609Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=896981gitlab # [ 10.837255] gitaly[896]: time="2026-08-29T13:39:17.609Z" level=info msg="Starting Gitaly" pid=896 version=982gitlab # [ 11.026262] gitaly[896]: time="2026-08-29T13:39:17.831Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=221 pid=896983gitlab # [ 11.028216] gitaly[896]: time="2026-08-29T13:39:17.831Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=896984gitlab # [ 11.029883] gitaly[896]: time="2026-08-29T13:39:17.831Z" level=info msg="finished initializing command factory" duration_ms=0 pid=896985gitlab # [ 11.031656] gitaly[896]: time="2026-08-29T13:39:17.831Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-896/git-exec-473610912.d/git pid=896986gitlab # [ 11.033839] gitaly[896]: time="2026-08-29T13:39:17.837Z" level=info msg="finished detecting git version" duration_ms=5 pid=896987gitlab # [ 11.035445] gitaly[896]: time="2026-08-29T13:39:17.837Z" level=info msg="using Git version" pid=896 version=2.53.g988gitlab # [ 11.037010] gitaly[896]: time="2026-08-29T13:39:17.837Z" level=info msg="clearing disk cache object folder" pid=896 storage=default989gitlab # [ 11.038660] gitaly[896]: time="2026-08-29T13:39:17.838Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache4231386501 pid=896 storage=default990gitlab # [ 11.041305] gitaly[896]: time="2026-08-29T13:39:17.838Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache4231386501 pid=896 storage=default991gitlab # [ 11.044021] gitaly[896]: time="2026-08-29T13:39:17.838Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=896992gitlab # [ 11.046358] gitaly[896]: time="2026-08-29T13:39:17.838Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=896993gitlab # [ 11.048867] gitaly[896]: time="2026-08-29T13:39:17.838Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache4231386501 clear_duration_ms=0 pid=896 storage=default994gitlab # [ 11.052662] gitaly[896]: time="2026-08-29T13:39:17.856Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=896995gitlab # [ 11.054870] gitaly[896]: time="2026-08-29T13:39:17.857Z" level=info msg="finished tempdir cleaner walk" pid=896 storage=default time_ms=0996gitlab # [ 11.056578] gitaly[896]: time="2026-08-29T13:39:17.857Z" level=info msg="counting repositories" pid=896997gitlab # [ 11.057841] gitaly[896]: time="2026-08-29T13:39:17.857Z" level=info msg="starting to count repositories" pid=896 storage_path=/var/gitlab/state/repositories998gitlab # [ 11.059691] gitaly[896]: time="2026-08-29T13:39:17.857Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=896 schema=unix999gitlab # [ 11.061791] gitaly[896]: time="2026-08-29T13:39:17.857Z" level=info msg="listening at address" address=/run/gitaly/gitaly-896/sock.d/intern pid=896 schema=unix1000gitlab # [ 11.063876] gitaly[896]: time="2026-08-29T13:39:17.857Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=896 storage_path=/var/gitlab/state/repositories1001gitlab # [ 11.066201] gitaly[896]: time="2026-08-29T13:39:17.857Z" level=info msg="completed counting all repositories" counting_duration=0 pid=8961002gitlab # [ 11.067916] gitaly[896]: time="2026-08-29T13:39:17.859Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=8961003gitlab # [ 11.069707] gitaly[896]: time="2026-08-29T13:39:17.859Z" level=info msg="Started Gitaly" duration_ms=249 pid=8961004gitlab # [ 11.071107] gitaly[896]: time="2026-08-29T13:39:17.859Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=8961005gitlab # [ 11.072815] gitaly[896]: time="2026-08-29T13:39:17.859Z" level=info msg="maintenance: daily scheduled" pid=896 scheduled="2026-08-30 12:00:00 +0000 UTC"1006gitlab # [ 11.688149] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[918]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1007gitlab # [ 11.699405] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[918]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1008gitlab # [ 11.709859] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[918]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1009gitlab # [ 14.157007] dhcpcd[755]: eth0: leased 10.0.2.15 for 86400 seconds1010gitlab # [ 14.159826] dhcpcd[755]: eth0: adding route to 10.0.2.0/241011gitlab # [ 14.162443] dhcpcd[755]: eth0: adding default route via 10.0.2.21012gitlab # [ 14.347117] systemd[1]: Started DHCP Client.1013gitlab # [ 14.352354] systemd[1]: Reached target Network is Online.1014gitlab # [ 14.446799] gitaly[896]: time="2026-08-29T13:39:21.250Z" level=info msg="License database preloaded" duration_ms=3641 pid=8961015gitlab # [ 58.384960] gitlab-workhorse[822]: time="2026-08-29T13:40:05Z" level=error correlation_id= duration_ms=3 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1016gitlab # [ 59.274416] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[918]: W, [2026-08-29T13:40:06.077003 #918] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1017gitlab # [ 62.602812] postgres[1459]: [1459] ERROR: relation "feature_gates" does not exist at character 5231018gitlab # [ 62.603302] postgres[1459]: [1459] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1019gitlab # [ 62.603430] postgres[1459]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1020gitlab # [ 62.603546] postgres[1459]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1021gitlab # [ 62.603665] postgres[1459]: attidentity AS identity,1022gitlab # [ 62.603776] postgres[1459]: attgenerated as attgenerated1023gitlab # [ 62.603893] postgres[1459]: FROM pg_attribute a1024gitlab # [ 62.624338] postgres[1459]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1025gitlab # [ 62.629191] postgres[1459]: LEFT JOIN pg_type t ON a.atttypid = t.oid1026gitlab # [ 62.631894] postgres[1459]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1027gitlab # [ 62.636168] postgres[1459]: WHERE a.attrelid = '"feature_gates"'::regclass1028gitlab # [ 62.639004] postgres[1459]: AND a.attnum > 0 AND NOT a.attisdropped1029gitlab # [ 62.641695] postgres[1459]: ORDER BY a.attnum1030gitlab # [ 62.643606] postgres[1459]:1031gitlab # [ 67.827725] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1510]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1032gitlab # [ 67.828313] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1510]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1033gitlab # [ 68.390211] gitlab-workhorse[822]: time="2026-08-29T13:40:15Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1034gitlab # [ 78.400423] gitlab-workhorse[822]: time="2026-08-29T13:40:25Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1035gitlab # [ 88.401853] gitlab-workhorse[822]: time="2026-08-29T13:40:35Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1036gitlab # [ 94.342212] postgres[1613]: [1613] ERROR: relation "table_without_models" does not exist1037gitlab # [ 94.342937] postgres[1613]: [1613] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1038gitlab # [ 98.410618] gitlab-workhorse[822]: time="2026-08-29T13:40:45Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1039gitlab # [ 108.418499] gitlab-workhorse[822]: time="2026-08-29T13:40:55Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1040gitlab # [ 118.433279] gitlab-workhorse[822]: time="2026-08-29T13:41:05Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1041gitlab # [ 124.637846] systemd[1]: Finished gitlab-db-config.service.1042gitlab # [ 124.645216] systemd[1]: Started gitlab-sidekiq.service.1043gitlab # [ 124.651190] systemd[1]: Starting gitlab.service...1044gitlab # [ 125.212109] bundle[1997]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1045gitlab # [ 125.218484] bundle[1997]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1046gitlab # [ 125.224463] bundle[1997]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1047gitlab # [ 128.430685] gitlab-workhorse[822]: time="2026-08-29T13:41:15Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1048gitlab # [ 129.839460] sidekiq-cluster[1996]: {"severity":"INFO","time":"2026-08-29T13:41:16.613Z","message":"Starting cluster with 1 processes"}1049gitlab # [ 130.026058] bundle[1997]: {"timestamp":"2026-08-29T13:41:16.800Z","pid":1997,"message":"* Enabling systemd notification integration"}1050gitlab # [ 130.031417] bundle[1997]: {"timestamp":"2026-08-29T13:41:16.829Z","pid":1997,"message":"Puma starting in cluster mode..."}1051gitlab # [ 130.036650] bundle[1997]: {"timestamp":"2026-08-29T13:41:16.829Z","pid":1997,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1052gitlab # [ 130.041335] bundle[1997]: {"timestamp":"2026-08-29T13:41:16.829Z","pid":1997,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1053gitlab # [ 130.047187] bundle[1997]: {"timestamp":"2026-08-29T13:41:16.830Z","pid":1997,"message":"* Min threads: 0"}1054gitlab # [ 130.051174] bundle[1997]: {"timestamp":"2026-08-29T13:41:16.830Z","pid":1997,"message":"* Max threads: 4"}1055gitlab # [ 130.055188] bundle[1997]: {"timestamp":"2026-08-29T13:41:16.830Z","pid":1997,"message":"* Environment: production"}1056gitlab # [ 130.059408] bundle[1997]: {"timestamp":"2026-08-29T13:41:16.830Z","pid":1997,"message":"* Master PID: 1997"}1057gitlab # [ 130.063479] bundle[1997]: {"timestamp":"2026-08-29T13:41:16.830Z","pid":1997,"message":"* Workers: 2"}1058gitlab # [ 130.067566] bundle[1997]: {"timestamp":"2026-08-29T13:41:16.830Z","pid":1997,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1059gitlab # [ 130.072763] bundle[1997]: {"timestamp":"2026-08-29T13:41:16.830Z","pid":1997,"message":"* Preloading application"}1060gitlab # [ 138.438203] gitlab-workhorse[822]: time="2026-08-29T13:41:25Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1061gitlab # [ 148.439569] gitlab-workhorse[822]: time="2026-08-29T13:41:35Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1062gitlab # [ 158.446181] gitlab-workhorse[822]: time="2026-08-29T13:41:45Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1063gitlab # [ 168.454195] gitlab-workhorse[822]: time="2026-08-29T13:41:55Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1064gitlab # [ 169.164742] bundle[1997]: W, [2026-08-29T13:41:55.968908 #1997] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1065gitlab # [ 172.975870] sidekiq-cluster[2047]: 2026-08-29T13:41:59.779Z pid=2047 tid=wnr INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2047, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>432283648}1066gitlab # [ 173.271311] sidekiq-cluster[2047]: W, [2026-08-29T13:42:00.075947 #2047] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1067gitlab # [ 173.340055] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:00.144Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1068gitlab # [ 177.267777] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.071Z","message":"GitLab reliable fetch activated!"}1069gitlab # [ 177.268207] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.071Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1070gitlab # [ 177.301457] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.106Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1071gitlab # [ 177.308516] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.109Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1072gitlab # [ 177.315446] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.112Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1073gitlab # [ 177.322213] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.114Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1074gitlab # [ 177.329710] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.117Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1075gitlab # [ 177.336745] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.120Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1076gitlab # [ 177.345086] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.122Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1077gitlab # [ 177.351236] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.124Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1078gitlab # [ 177.357055] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.126Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1079gitlab # [ 177.363274] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.128Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1080gitlab # [ 177.369439] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.130Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1081gitlab # [ 177.375326] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.133Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1082gitlab # [ 177.384217] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.135Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1083gitlab # [ 177.392409] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.137Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1084gitlab # [ 177.397061] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.140Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1085gitlab # [ 177.401334] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.143Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1086gitlab # [ 177.405150] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.153Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1087gitlab # [ 177.408537] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.162Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1088gitlab # [ 177.412101] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.169Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1089gitlab # [ 177.415326] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.176Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1090gitlab # [ 177.419023] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.182Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1091gitlab # [ 177.422699] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.188Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1092gitlab # [ 177.425809] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.193Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1093gitlab # [ 177.428743] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.197Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1094gitlab # [ 177.431606] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.201Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1095gitlab # [ 177.434453] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.205Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1096gitlab # [ 177.437037] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.209Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1097gitlab # [ 177.439542] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.212Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1098gitlab # [ 177.442226] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.216Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1099gitlab # [ 177.444836] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.220Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1100gitlab # [ 177.447067] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.223Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1101gitlab # [ 177.449659] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.226Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1102gitlab # [ 177.451777] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.229Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1103gitlab # [ 177.454237] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.232Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1104gitlab # [ 177.456436] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.234Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1105gitlab # [ 177.458619] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.236Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1106gitlab # [ 177.460922] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.238Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1107gitlab # [ 177.462999] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.241Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1108gitlab # [ 177.465156] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.243Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1109gitlab # [ 177.467161] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.245Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1110gitlab # [ 177.469415] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.247Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1111gitlab # [ 177.471478] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.249Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1112gitlab # [ 177.473783] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.251Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1113gitlab # [ 177.475777] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.253Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1114gitlab # [ 177.478098] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.255Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1115gitlab # [ 177.480321] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.258Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1116gitlab # [ 177.482406] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.259Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1117gitlab # [ 177.484532] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.261Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1118gitlab # [ 177.486552] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.264Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1119gitlab # [ 177.488600] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.266Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1120gitlab # [ 177.490591] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.268Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1121gitlab # [ 177.492638] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.270Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1122gitlab # [ 177.494646] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.284Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1123gitlab # [ 177.496959] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.286Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1124gitlab # [ 177.499103] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.289Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1125gitlab # [ 177.501325] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.291Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1126gitlab # [ 177.503430] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.293Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1127gitlab # [ 177.505848] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.296Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1128gitlab # [ 177.508031] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.297Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1129gitlab # [ 177.510221] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.299Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1130gitlab # [ 177.512206] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.301Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1131gitlab # [ 177.514182] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.303Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1132gitlab # [ 177.516306] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.305Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1133gitlab # [ 177.518424] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.308Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1134gitlab # [ 177.520651] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.310Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1135gitlab # [ 177.522751] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.313Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1136gitlab # [ 177.524821] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.314Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1137gitlab # [ 177.526964] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.316Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1138gitlab # [ 177.529246] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.318Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1139gitlab # [ 177.531614] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.319Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1140gitlab # [ 177.533911] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.321Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1141gitlab # [ 177.536020] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.323Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1142gitlab # [ 177.538174] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.324Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1143gitlab # [ 177.540485] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.326Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1144gitlab # [ 177.542777] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.328Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1145gitlab # [ 177.545162] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.329Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1146gitlab # [ 177.547316] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.331Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1147gitlab # [ 177.549914] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.333Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1148gitlab # [ 177.552061] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.334Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1149gitlab # [ 177.554165] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.336Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1150gitlab # [ 177.556504] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.338Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1151gitlab # [ 177.558836] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.339Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1152gitlab # [ 177.561153] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.342Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1153gitlab # [ 177.563299] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.343Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1154gitlab # [ 177.565734] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.345Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1155gitlab # [ 177.567859] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.347Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1156gitlab # [ 177.570278] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.349Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1157gitlab # [ 177.572439] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.351Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1158gitlab # [ 177.574616] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.353Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1159gitlab # [ 177.576856] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.355Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1160gitlab # [ 177.579061] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.356Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1161gitlab # [ 177.581372] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.358Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1162gitlab # [ 177.583581] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.360Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1163gitlab # [ 177.587123] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.361Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1164gitlab # [ 177.589209] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.364Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1165gitlab # [ 177.591522] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.366Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1166gitlab # [ 177.593919] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.368Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1167gitlab # [ 177.596135] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.370Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1168gitlab # [ 177.598310] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.382Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1169gitlab # [ 177.600509] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.384Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1170gitlab # [ 177.602632] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.386Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1171gitlab # [ 177.604895] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.390Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1172gitlab # [ 177.606903] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.392Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1173gitlab # [ 177.609089] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.395Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1174gitlab # [ 177.611305] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.397Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1175gitlab # [ 177.613679] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.399Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1176gitlab # [ 177.638631] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.443Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1177gitlab # [ 177.641531] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.446Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1178gitlab # [ 177.644191] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:04.448Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1179gitlab # [ 178.462638] gitlab-workhorse[822]: time="2026-08-29T13:42:05Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1180gitlab # [ 188.470333] gitlab-workhorse[822]: time="2026-08-29T13:42:15Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1181gitlab # [ 198.474605] gitlab-workhorse[822]: time="2026-08-29T13:42:25Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1182gitlab # [ 208.483120] gitlab-workhorse[822]: time="2026-08-29T13:42:35Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1183gitlab # [ 217.616493] postgres[2784]: [2784] ERROR: relation "table_without_models" does not exist1184gitlab # [ 217.616831] postgres[2784]: [2784] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1185gitlab # [ 218.490375] gitlab-workhorse[822]: time="2026-08-29T13:42:45Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1186gitlab # [ 219.862139] postgres[2805]: [2805] ERROR: relation "table_without_models" does not exist1187gitlab # [ 219.865102] postgres[2805]: [2805] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1188gitlab # [ 222.554465] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:49.357Z","message":"Booted Rails 7.2.3.1 application in production environment"}1189gitlab # [ 222.562232] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:49.366Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1190gitlab # [ 222.569640] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:49.367Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1191gitlab # [ 222.575188] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:49.367Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1192gitlab # [ 222.581459] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:49.375Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1193gitlab # [ 225.338946] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:52.141Z","message":"Cleaning working queues"}1194gitlab # [ 225.347967] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:52.152Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"703a10a9a60fed92ee05aa7a","created_at":"2026-08-29T13:41:10.915Z","trace_propagation_headers":{"sentry-trace":"b63147a30b6e4c3d88e276b90eb4d4b7-92637b6170c94a5a","baggage":"sentry-trace_id=b63147a30b6e4c3d88e276b90eb4d4b7,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"41cabd4d983027fb31b43272c181e90e","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-29T13:41:10.926Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-703a10a9a60fed92ee05aa7a: start","job_status":"start","queue_duration_s":101.225355,"scheduling_latency_s":101.225468}1195gitlab # [ 225.747485] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:42:52.551Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"703a10a9a60fed92ee05aa7a","created_at":"2026-08-29T13:41:10.915Z","trace_propagation_headers":{"sentry-trace":"b63147a30b6e4c3d88e276b90eb4d4b7-92637b6170c94a5a","baggage":"sentry-trace_id=b63147a30b6e4c3d88e276b90eb4d4b7,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"41cabd4d983027fb31b43272c181e90e","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-29T13:41:10.926Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-703a10a9a60fed92ee05aa7a: done: 0.399697 sec","job_status":"done","queue_duration_s":101.225355,"scheduling_latency_s":101.225468,"redis_calls":29,"redis_duration_s":0.01218,"redis_read_bytes":282,"redis_write_bytes":3632,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.007005,"redis_feature_flag_read_bytes":272,"redis_feature_flag_write_bytes":2385,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003204,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001971,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":15,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.201318,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.2059159,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.399697,"completed_at":"2026-08-29T13:42:52.551Z","load_balancing_strategy":"primary","db_duration_s":0.10899,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1196gitlab # [ 226.786362] bundle[1997]: {"timestamp":"2026-08-29T13:42:53.590Z","pid":1997,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1197gitlab # [ 226.786689] bundle[1997]: {"timestamp":"2026-08-29T13:42:53.590Z","pid":1997,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1198gitlab # [ 226.786858] bundle[1997]: {"timestamp":"2026-08-29T13:42:53.590Z","pid":1997,"message":"! #\u003cThread:0x0000feb4867eb410 /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1199gitlab # [ 226.787013] bundle[1997]: {"timestamp":"2026-08-29T13:42:53.590Z","pid":1997,"message":"! #\u003cThread:0x0000feb486045e68 /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1200gitlab # [ 226.787128] bundle[1997]: {"timestamp":"2026-08-29T13:42:53.590Z","pid":1997,"message":"Use Ctrl-C to stop"}1201gitlab # [ 226.787234] bundle[1997]: {"timestamp":"2026-08-29T13:42:53.590Z","pid":1997,"message":"Sending status to systemd every 1.0 sec"}1202gitlab # [ 227.486827] bundle[1997]: {"timestamp":"2026-08-29T13:42:54.291Z","pid":1997,"message":"- Worker 0 (PID: 2922) booted in 0.66s, phase: 0"}1203gitlab # [ 227.490235] bundle[1997]: {"timestamp":"2026-08-29T13:42:54.293Z","pid":1997,"message":"- Worker 1 (PID: 2926) booted in 0.64s, phase: 0"}1204gitlab # [ 227.500640] systemd[1]: Started gitlab.service.1205gitlab # [ 227.502102] systemd[1]: Reached target Common target for all GitLab services..1206gitlab # [ 227.508478] systemd[1]: Starting setup-gitlab.service...1207gitlab # [ 227.565253] setup-gitlab-start[2959]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1208gitlab # [ 231.108106] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:42:57 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 34901209gitlab # [ 231.115744] setup-gitlab-start[2959]: + TOKEN=nixbot-test-token-of-20-chars1210gitlab # [ 231.119134] setup-gitlab-start[2959]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1211gitlab # [ 231.135658] runuser[2986]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1212gitlab # [ 231.698640] setup-gitlab-start[2987]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1213gitlab # [ 231.705767] setup-gitlab-start[2987]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1214gitlab # [ 231.712223] setup-gitlab-start[2987]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1215gitlab # [ 232.514547] setup-gitlab-start[2987]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1216gitlab # [ 232.514889] setup-gitlab-start[2987]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1217gitlab # [ 232.517301] setup-gitlab-start[2987]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1218gitlab # [ 238.128085] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:04.931Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"964a7221b2ca19378306c028","created_at":"2026-08-29T13:43:04.815Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f247205459ef7c926ee333451f3e4ad8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-29T13:43:04.926Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-964a7221b2ca19378306c028: start","job_status":"start","queue_duration_s":0.004947,"scheduling_latency_s":0.005013}1219gitlab # [ 238.225146] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:05.029Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1220gitlab # [ 238.288502] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:05.092Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"964a7221b2ca19378306c028","created_at":"2026-08-29T13:43:04.815Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f247205459ef7c926ee333451f3e4ad8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-29T13:43:04.926Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-964a7221b2ca19378306c028: done: 0.161315 sec","job_status":"done","queue_duration_s":0.004947,"scheduling_latency_s":0.005013,"redis_calls":10,"redis_duration_s":0.012361,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002842,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006908,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002611,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041562,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00489438,"duration_s":0.161315,"completed_at":"2026-08-29T13:43:05.092Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.021953,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1221gitlab # [ 238.365902] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:05.109Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"c1a29b5ab157fbd4bfb9ad1a","created_at":"2026-08-29T13:43:04.947Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1e7af38ff49d1701ee0f529eae32d088","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-29T13:43:04.980Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-c1a29b5ab157fbd4bfb9ad1a: start","job_status":"start","queue_duration_s":0.128718,"scheduling_latency_s":0.128826}1222gitlab # [ 238.508887] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:05.311Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"c1a29b5ab157fbd4bfb9ad1a","created_at":"2026-08-29T13:43:04.947Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1e7af38ff49d1701ee0f529eae32d088","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-29T13:43:04.980Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-c1a29b5ab157fbd4bfb9ad1a: done: 0.202885 sec","job_status":"done","queue_duration_s":0.128718,"scheduling_latency_s":0.128826,"redis_calls":16,"redis_duration_s":0.037256,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.012938,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.013469,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.010849,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.069,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.069,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.064362,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0027008,"duration_s":0.202885,"completed_at":"2026-08-29T13:43:05.311Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.077725,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1223gitlab # [ 238.589424] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:05.323Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"f8d2a443ed5438eb32f659e8","created_at":"2026-08-29T13:43:04.990Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3678d80ef775edec4a74c4ef8145cd25","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-29T13:43:05.000Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-f8d2a443ed5438eb32f659e8: start","job_status":"start","queue_duration_s":0.322841,"scheduling_latency_s":0.322894}1224gitlab # [ 238.971462] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:05.774Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"f8d2a443ed5438eb32f659e8","created_at":"2026-08-29T13:43:04.990Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3678d80ef775edec4a74c4ef8145cd25","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-29T13:43:05.000Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-f8d2a443ed5438eb32f659e8: done: 0.451711 sec","job_status":"done","queue_duration_s":0.322841,"scheduling_latency_s":0.322894,"redis_calls":14,"redis_duration_s":0.014583,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.003297,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007622,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003664,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.102,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.03,"db_ci_duration_s":0.072,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.165666,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00163066,"exclusive_lock_hold_duration_s":0.33004318,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.451711,"completed_at":"2026-08-29T13:43:05.774Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.129818,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1225gitlab # [ 239.051380] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:05.795Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"9731b77f3c9c22e5ec8f35d6","created_at":"2026-08-29T13:43:05.008Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6502b84be4929b8a22c6569b99991932","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-29T13:43:05.019Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-9731b77f3c9c22e5ec8f35d6: start","job_status":"start","queue_duration_s":0.775943,"scheduling_latency_s":0.775993}1226gitlab # [ 239.114260] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:05.917Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"9731b77f3c9c22e5ec8f35d6","created_at":"2026-08-29T13:43:05.008Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6502b84be4929b8a22c6569b99991932","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-29T13:43:05.019Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-9731b77f3c9c22e5ec8f35d6: done: 0.122345 sec","job_status":"done","queue_duration_s":0.775943,"scheduling_latency_s":0.775993,"redis_calls":12,"redis_duration_s":0.004466,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001547,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002085,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000834,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037993,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0011623,"duration_s":0.122345,"completed_at":"2026-08-29T13:43:05.917Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003801,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1227gitlab # [ 239.203032] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:05.924Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"07e3afd316bba083e8e3f8ae","created_at":"2026-08-29T13:43:05.055Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8c5842c75b3c5561d240b0a3daee7ad0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-29T13:43:05.080Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-07e3afd316bba083e8e3f8ae: start","job_status":"start","queue_duration_s":0.84377,"scheduling_latency_s":0.843824}1228gitlab # [ 239.221323] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:05.977Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1229gitlab # [ 239.224817] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:05.989Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"07e3afd316bba083e8e3f8ae","created_at":"2026-08-29T13:43:05.055Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8c5842c75b3c5561d240b0a3daee7ad0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-29T13:43:05.080Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-07e3afd316bba083e8e3f8ae: done: 0.065098 sec","job_status":"done","queue_duration_s":0.84377,"scheduling_latency_s":0.843824,"redis_calls":10,"redis_duration_s":0.002116,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00043,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001238,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000448,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018793,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037982,"duration_s":0.065098,"completed_at":"2026-08-29T13:43:05.989Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00374,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1230gitlab # [ 239.267866] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:05.991Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"1a62a4b951a30123a9f65f0c","created_at":"2026-08-29T13:43:05.094Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f5355debefa44683262d9129b982c1e1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-29T13:43:05.105Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-1a62a4b951a30123a9f65f0c: start","job_status":"start","queue_duration_s":0.886378,"scheduling_latency_s":0.88641}1231gitlab # [ 239.282512] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:06.009Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1232gitlab # [ 239.286270] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:06.020Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"1a62a4b951a30123a9f65f0c","created_at":"2026-08-29T13:43:05.094Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f5355debefa44683262d9129b982c1e1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-29T13:43:05.105Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-1a62a4b951a30123a9f65f0c: done: 0.028496 sec","job_status":"done","queue_duration_s":0.886378,"scheduling_latency_s":0.88641,"redis_calls":10,"redis_duration_s":0.00198,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000395,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001184,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000401,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016783,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00067398,"duration_s":0.028496,"completed_at":"2026-08-29T13:43:06.020Z","load_balancing_strategy":"primary","db_duration_s":0.000541,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1233gitlab # [ 239.327141] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:06.022Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"04a77f84a4bfcc111931645d","created_at":"2026-08-29T13:43:05.135Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d7441c24a324c85501db6abe2b08c655","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-29T13:43:05.156Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-04a77f84a4bfcc111931645d: start","job_status":"start","queue_duration_s":0.865512,"scheduling_latency_s":0.865534}1234gitlab # [ 239.341630] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:06.048Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"04a77f84a4bfcc111931645d","created_at":"2026-08-29T13:43:05.135Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d7441c24a324c85501db6abe2b08c655","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-29T13:43:05.156Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-04a77f84a4bfcc111931645d: done: 0.026103 sec","job_status":"done","queue_duration_s":0.865512,"scheduling_latency_s":0.865534,"redis_calls":12,"redis_duration_s":0.0021390000000000003,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000335,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001092,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000712,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016021,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0005302,"exclusive_lock_hold_duration_s":0.00402054,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.026103,"completed_at":"2026-08-29T13:43:06.048Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001896,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1235gitlab # [ 239.384663] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:06.049Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"ff769c34d5831c7f649a81d2","created_at":"2026-08-29T13:43:05.178Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f2172f9acb0f03df652b26f10fe2d704","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-29T13:43:05.201Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-ff769c34d5831c7f649a81d2: start","job_status":"start","queue_duration_s":0.848169,"scheduling_latency_s":0.848194}1236gitlab # [ 239.398598] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:06.083Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"ff769c34d5831c7f649a81d2","created_at":"2026-08-29T13:43:05.178Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f2172f9acb0f03df652b26f10fe2d704","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-29T13:43:05.201Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-ff769c34d5831c7f649a81d2: done: 0.034031 sec","job_status":"done","queue_duration_s":0.848169,"scheduling_latency_s":0.848194,"redis_calls":10,"redis_duration_s":0.001532,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000374,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00084,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000318,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016099,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025018,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.034031,"completed_at":"2026-08-29T13:43:06.083Z","load_balancing_strategy":"primary","db_duration_s":0.010613,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1237gitlab # [ 239.441044] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:06.085Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"6a5007fc14e2977b918590e9","created_at":"2026-08-29T13:43:05.260Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8393b82572ddc4440266537d0b5fba86","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-29T13:43:05.287Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-6a5007fc14e2977b918590e9: start","job_status":"start","queue_duration_s":0.797623,"scheduling_latency_s":0.797641}1238gitlab # [ 239.455631] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:06.116Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"6a5007fc14e2977b918590e9","created_at":"2026-08-29T13:43:05.260Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8393b82572ddc4440266537d0b5fba86","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-29T13:43:05.287Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-6a5007fc14e2977b918590e9: done: 0.031489 sec","job_status":"done","queue_duration_s":0.797623,"scheduling_latency_s":0.797641,"redis_calls":13,"redis_duration_s":0.0017989999999999998,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000276,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000886,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000637,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022487,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0104751,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.031489,"completed_at":"2026-08-29T13:43:06.116Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002101,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1239gitlab # [ 239.501606] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:06.118Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"987836d6a368afe51f49225d","created_at":"2026-08-29T13:43:05.314Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"75241096739356242f0a781526fc5d2c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-29T13:43:05.330Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-987836d6a368afe51f49225d: start","job_status":"start","queue_duration_s":0.787911,"scheduling_latency_s":0.787928}1240gitlab # [ 239.515453] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:06.154Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"987836d6a368afe51f49225d","created_at":"2026-08-29T13:43:05.314Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"75241096739356242f0a781526fc5d2c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-29T13:43:05.330Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-987836d6a368afe51f49225d: done: 0.036623 sec","job_status":"done","queue_duration_s":0.787911,"scheduling_latency_s":0.787928,"redis_calls":19,"redis_duration_s":0.002809,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000767,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000254,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.001343,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000445,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0273,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023276,"duration_s":0.036623,"completed_at":"2026-08-29T13:43:06.154Z","load_balancing_strategy":"primary","db_duration_s":0.001598,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1241gitlab # [ 239.558454] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:06.156Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"dd7d44f29fd7e704c47e7a59","created_at":"2026-08-29T13:43:05.401Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cd5ad0f514db223ddb30decc58dc65be","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-29T13:43:05.447Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-dd7d44f29fd7e704c47e7a59: start","job_status":"start","queue_duration_s":0.708878,"scheduling_latency_s":0.708899}1242gitlab # [ 239.685611] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:06.489Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"dd7d44f29fd7e704c47e7a59","created_at":"2026-08-29T13:43:05.401Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cd5ad0f514db223ddb30decc58dc65be","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-29T13:43:05.447Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-dd7d44f29fd7e704c47e7a59: done: 0.333853 sec","job_status":"done","queue_duration_s":0.708878,"scheduling_latency_s":0.708899,"redis_calls":565,"redis_duration_s":0.058648,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000299,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000841,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.057508,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.308994,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026282,"duration_s":0.333853,"completed_at":"2026-08-29T13:43:06.489Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000754,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1243gitlab # [ 239.781939] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:06.491Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"ad1716d64b515b4ed42c9717","created_at":"2026-08-29T13:43:05.492Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"86756a5bc17dfcedff5fa1402aa1d28c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-29T13:43:05.505Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-ad1716d64b515b4ed42c9717: start","job_status":"start","queue_duration_s":0.985973,"scheduling_latency_s":0.985998}1244gitlab # [ 239.799169] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:06.505Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1245gitlab # [ 239.803179] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:06.513Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"ad1716d64b515b4ed42c9717","created_at":"2026-08-29T13:43:05.492Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"86756a5bc17dfcedff5fa1402aa1d28c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-29T13:43:05.505Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-ad1716d64b515b4ed42c9717: done: 0.021882 sec","job_status":"done","queue_duration_s":0.985973,"scheduling_latency_s":0.985998,"redis_calls":10,"redis_duration_s":0.00174,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00049,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000919,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000331,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012763,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025922,"duration_s":0.021882,"completed_at":"2026-08-29T13:43:06.513Z","load_balancing_strategy":"primary","db_duration_s":0.000638,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1246gitlab # [ 239.847251] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:06.514Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"0567a347ea7e77ae9f49574c","created_at":"2026-08-29T13:43:05.519Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8ebd21afb7eb2a4d00402efcf069410b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-29T13:43:05.530Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-0567a347ea7e77ae9f49574c: start","job_status":"start","queue_duration_s":0.98376,"scheduling_latency_s":0.983778}1247gitlab # [ 239.862497] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:06.527Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1248gitlab # [ 239.866027] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:06.535Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"0567a347ea7e77ae9f49574c","created_at":"2026-08-29T13:43:05.519Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8ebd21afb7eb2a4d00402efcf069410b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-29T13:43:05.530Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-0567a347ea7e77ae9f49574c: done: 0.021039 sec","job_status":"done","queue_duration_s":0.98376,"scheduling_latency_s":0.983778,"redis_calls":10,"redis_duration_s":0.001942,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000363,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001249,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00033,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012447,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00028408,"duration_s":0.021039,"completed_at":"2026-08-29T13:43:06.535Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000569,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1249gitlab # [ 239.911118] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:06.537Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"06a461f1b02e2384db1c9432","created_at":"2026-08-29T13:43:05.539Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-29T13:43:05.549Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-06a461f1b02e2384db1c9432: start","job_status":"start","queue_duration_s":0.987771,"scheduling_latency_s":0.98779}1250gitlab # [ 239.925499] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:06.653Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"06a461f1b02e2384db1c9432","created_at":"2026-08-29T13:43:05.539Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-29T13:43:05.549Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-06a461f1b02e2384db1c9432: done: 0.116243 sec","job_status":"done","queue_duration_s":0.987771,"scheduling_latency_s":0.98779,"redis_calls":71,"redis_duration_s":0.018015,"redis_read_bytes":120,"redis_write_bytes":42574,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002256,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.0013,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37385,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.013823,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000636,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.096174,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034242,"duration_s":0.116243,"completed_at":"2026-08-29T13:43:06.653Z","load_balancing_strategy":"primary","db_duration_s":0.002648,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1251gitlab # [ 239.970015] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:06.655Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"828486bc47314603a59e2b74","created_at":"2026-08-29T13:43:05.556Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aee36dcfd0f1e7e3e9843e342380cd2a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-29T13:43:05.565Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-828486bc47314603a59e2b74: start","job_status":"start","queue_duration_s":1.089849,"scheduling_latency_s":1.089868}1252gitlab # [ 239.984898] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:06.677Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"828486bc47314603a59e2b74","created_at":"2026-08-29T13:43:05.556Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aee36dcfd0f1e7e3e9843e342380cd2a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-29T13:43:05.565Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-828486bc47314603a59e2b74: done: 0.021918 sec","job_status":"done","queue_duration_s":1.089849,"scheduling_latency_s":1.089868,"redis_calls":10,"redis_duration_s":0.002454,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000519,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001419,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000516,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012289,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034098,"duration_s":0.021918,"completed_at":"2026-08-29T13:43:06.677Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000848,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1253gitlab # [ 240.028069] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:06.678Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"52668339393a83f45977049a","created_at":"2026-08-29T13:43:05.582Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6d9fa9b9e3a6ad9e9de99578f12f1df8","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-29T13:43:05.590Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-52668339393a83f45977049a: start","job_status":"start","queue_duration_s":1.088841,"scheduling_latency_s":1.088859}1254gitlab # [ 240.042321] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:06.711Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"52668339393a83f45977049a","created_at":"2026-08-29T13:43:05.582Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6d9fa9b9e3a6ad9e9de99578f12f1df8","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-29T13:43:05.590Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-52668339393a83f45977049a: done: 0.032595 sec","job_status":"done","queue_duration_s":1.088841,"scheduling_latency_s":1.088859,"redis_calls":10,"redis_duration_s":0.004771,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002626,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001618,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000527,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016298,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036908,"duration_s":0.032595,"completed_at":"2026-08-29T13:43:06.711Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005548,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1255gitlab # [ 240.085096] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:06.713Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"a86062880de869b1db303971","created_at":"2026-08-29T13:43:05.616Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"98c0b67dac1ece7976a9293f34acf2c5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-29T13:43:05.626Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-a86062880de869b1db303971: start","job_status":"start","queue_duration_s":1.086549,"scheduling_latency_s":1.086567}1256gitlab # [ 240.099578] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:06.752Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"a86062880de869b1db303971","created_at":"2026-08-29T13:43:05.616Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"98c0b67dac1ece7976a9293f34acf2c5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-29T13:43:05.626Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-a86062880de869b1db303971: done: 0.038965 sec","job_status":"done","queue_duration_s":1.086549,"scheduling_latency_s":1.086567,"redis_calls":10,"redis_duration_s":0.003159,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001029,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001569,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000561,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022316,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00038306,"duration_s":0.038965,"completed_at":"2026-08-29T13:43:06.752Z","load_balancing_strategy":"primary","db_duration_s":0.00755,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1257gitlab # [ 240.140923] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:06.753Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"7fc4b2192ebd4e7522698e7c","created_at":"2026-08-29T13:43:05.685Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c725d9940bdb69ae071013fe7dfbc233","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-29T13:43:05.692Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-7fc4b2192ebd4e7522698e7c: start","job_status":"start","queue_duration_s":1.061243,"scheduling_latency_s":1.06126}1258gitlab # [ 240.155709] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:06.823Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"7fc4b2192ebd4e7522698e7c","created_at":"2026-08-29T13:43:05.685Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c725d9940bdb69ae071013fe7dfbc233","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-29T13:43:05.692Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-7fc4b2192ebd4e7522698e7c: done: 0.069299 sec","job_status":"done","queue_duration_s":1.061243,"scheduling_latency_s":1.06126,"redis_calls":12,"redis_duration_s":0.003641,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000561,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001644,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001436,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.035,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.035,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024034,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00080654,"exclusive_lock_hold_duration_s":0.02613714,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.069299,"completed_at":"2026-08-29T13:43:06.823Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.035993,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1259gitlab # [ 240.200853] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:06.825Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"d89c110fc694b109acf18994","created_at":"2026-08-29T13:43:05.708Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"277c90b9c41e14f741cfaff85cd51c77","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-29T13:43:05.722Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-d89c110fc694b109acf18994: start","job_status":"start","queue_duration_s":1.103021,"scheduling_latency_s":1.103042}1260gitlab # [ 240.266953] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.070Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"d89c110fc694b109acf18994","created_at":"2026-08-29T13:43:05.708Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"277c90b9c41e14f741cfaff85cd51c77","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-29T13:43:05.722Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-d89c110fc694b109acf18994: done: 0.245065 sec","job_status":"done","queue_duration_s":1.103021,"scheduling_latency_s":1.103042,"redis_calls":12,"redis_duration_s":0.003492,"redis_read_bytes":11,"redis_write_bytes":1370,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000619,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001527,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001346,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.028,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.207162,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0007191,"exclusive_lock_hold_duration_s":0.21933888,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.245065,"completed_at":"2026-08-29T13:43:07.070Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.043933,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1261gitlab # [ 240.329358] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.072Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PipelineScheduleWorker","jid":"7637374def82e205dfedcc9b","created_at":"2026-08-29T13:43:05.742Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6c40460169077548de1a580c42b32a50","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f6baa6e6d21754c4b13358fe49f8c31a08729a9dd276fb680a810caf1bc7fab5","size_limiter":"validated","enqueued_at":"2026-08-29T13:43:05.768Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineScheduleWorker JID-7637374def82e205dfedcc9b: start","job_status":"start","queue_duration_s":1.304367,"scheduling_latency_s":1.304389}1262gitlab # [ 240.344244] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.107Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PipelineScheduleWorker","jid":"7637374def82e205dfedcc9b","created_at":"2026-08-29T13:43:05.742Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6c40460169077548de1a580c42b32a50","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f6baa6e6d21754c4b13358fe49f8c31a08729a9dd276fb680a810caf1bc7fab5","size_limiter":"validated","enqueued_at":"2026-08-29T13:43:05.768Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineScheduleWorker JID-7637374def82e205dfedcc9b: done: 0.034633 sec","job_status":"done","queue_duration_s":1.304367,"scheduling_latency_s":1.304389,"redis_calls":12,"redis_duration_s":0.003473,"redis_read_bytes":11,"redis_write_bytes":1281,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000573,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001794,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":518,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001106,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":476,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021459,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00061928,"exclusive_lock_hold_duration_s":0.01113544,"duration_s":0.034633,"completed_at":"2026-08-29T13:43:07.107Z","load_balancing_strategy":"primary","db_duration_s":0.004109,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1263gitlab # [ 240.385997] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.109Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"b552a46c0beb4b830376409c","created_at":"2026-08-29T13:43:05.797Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"192edaec9b06461d09d319354b875461","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-29T13:43:05.810Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-b552a46c0beb4b830376409c: start","job_status":"start","queue_duration_s":1.298058,"scheduling_latency_s":1.298077}1264gitlab # [ 240.400485] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.122Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1265gitlab # [ 240.403879] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.130Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"b552a46c0beb4b830376409c","created_at":"2026-08-29T13:43:05.797Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"192edaec9b06461d09d319354b875461","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-29T13:43:05.810Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-b552a46c0beb4b830376409c: done: 0.021721 sec","job_status":"done","queue_duration_s":1.298058,"scheduling_latency_s":1.298077,"redis_calls":10,"redis_duration_s":0.003009,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000528,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001979,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000502,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011782,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00086296,"duration_s":0.021721,"completed_at":"2026-08-29T13:43:07.130Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000734,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1266gitlab # [ 240.446634] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.132Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"e689cb002d9a9f4b70c401e0","created_at":"2026-08-29T13:43:05.904Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5e0f4fdf09b6d50152214e91918ad2ba","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-29T13:43:05.929Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-e689cb002d9a9f4b70c401e0: start","job_status":"start","queue_duration_s":1.202964,"scheduling_latency_s":1.202981}1267gitlab # [ 240.460373] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.168Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"e689cb002d9a9f4b70c401e0","created_at":"2026-08-29T13:43:05.904Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5e0f4fdf09b6d50152214e91918ad2ba","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-29T13:43:05.929Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-e689cb002d9a9f4b70c401e0: done: 0.035932 sec","job_status":"done","queue_duration_s":1.202964,"scheduling_latency_s":1.202981,"redis_calls":12,"redis_duration_s":0.006654,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00057,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001561,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.004523,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017173,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00054138,"exclusive_lock_hold_duration_s":0.01077144,"duration_s":0.035932,"completed_at":"2026-08-29T13:43:07.168Z","load_balancing_strategy":"primary","db_duration_s":0.006962,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1268gitlab # [ 240.502710] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.169Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a58ad5c07d719953bd3ad00f","created_at":"2026-08-29T13:43:06.133Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-ea35ee6eda2c47a8","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"75241096739356242f0a781526fc5d2c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.147Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a58ad5c07d719953bd3ad00f: start","job_status":"start","queue_duration_s":1.022662,"scheduling_latency_s":1.022679}1269gitlab # [ 240.514963] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.188Z","message":"No existing merge request to be cleaned up."}1270gitlab # [ 240.516660] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.207Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a58ad5c07d719953bd3ad00f","created_at":"2026-08-29T13:43:06.133Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-ea35ee6eda2c47a8","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"75241096739356242f0a781526fc5d2c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.147Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a58ad5c07d719953bd3ad00f: done: 0.037371 sec","job_status":"done","queue_duration_s":1.022662,"scheduling_latency_s":1.022679,"redis_calls":13,"redis_duration_s":0.003947,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000623,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001391,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001933,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020815,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004388,"duration_s":0.037371,"completed_at":"2026-08-29T13:43:07.207Z","load_balancing_strategy":"primary","db_duration_s":0.005931,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1271gitlab # [ 240.556665] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.208Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"edc2326b1483e753e9c19dfd","created_at":"2026-08-29T13:43:06.133Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-ea35ee6eda2c47a8","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"75241096739356242f0a781526fc5d2c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.147Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-edc2326b1483e753e9c19dfd: start","job_status":"start","queue_duration_s":1.061582,"scheduling_latency_s":1.061601}1272gitlab # [ 240.568841] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.221Z","message":"No existing merge request to be cleaned up."}1273gitlab # [ 240.570473] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.231Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"edc2326b1483e753e9c19dfd","created_at":"2026-08-29T13:43:06.133Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-ea35ee6eda2c47a8","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"75241096739356242f0a781526fc5d2c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.147Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-edc2326b1483e753e9c19dfd: done: 0.022348 sec","job_status":"done","queue_duration_s":1.061582,"scheduling_latency_s":1.061601,"redis_calls":10,"redis_duration_s":0.002879,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001307,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001572,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01395,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022348,"completed_at":"2026-08-29T13:43:07.231Z","load_balancing_strategy":"primary","db_duration_s":0.002735,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1274gitlab # [ 240.608469] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.232Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a5b2e4fb5212230454747e89","created_at":"2026-08-29T13:43:06.133Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-ea35ee6eda2c47a8","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"75241096739356242f0a781526fc5d2c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.147Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a5b2e4fb5212230454747e89: start","job_status":"start","queue_duration_s":1.085421,"scheduling_latency_s":1.085438}1275gitlab # [ 240.620585] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.244Z","message":"No existing merge request to be cleaned up."}1276gitlab # [ 240.622215] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.253Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a5b2e4fb5212230454747e89","created_at":"2026-08-29T13:43:06.133Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-ea35ee6eda2c47a8","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"75241096739356242f0a781526fc5d2c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.147Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a5b2e4fb5212230454747e89: done: 0.021272 sec","job_status":"done","queue_duration_s":1.085421,"scheduling_latency_s":1.085438,"redis_calls":10,"redis_duration_s":0.002872,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001239,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001633,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013539,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021272,"completed_at":"2026-08-29T13:43:07.253Z","load_balancing_strategy":"primary","db_duration_s":0.002658,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1277gitlab # [ 240.660888] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.255Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"cc88a21b33987d115f6cb175","created_at":"2026-08-29T13:43:06.133Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-ea35ee6eda2c47a8","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"75241096739356242f0a781526fc5d2c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.147Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-cc88a21b33987d115f6cb175: start","job_status":"start","queue_duration_s":1.108417,"scheduling_latency_s":1.108435}1278gitlab # [ 240.673529] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.267Z","message":"No existing merge request to be cleaned up."}1279gitlab # [ 240.675240] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.276Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"cc88a21b33987d115f6cb175","created_at":"2026-08-29T13:43:06.133Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-ea35ee6eda2c47a8","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"75241096739356242f0a781526fc5d2c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.147Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-cc88a21b33987d115f6cb175: done: 0.021193 sec","job_status":"done","queue_duration_s":1.108417,"scheduling_latency_s":1.108435,"redis_calls":10,"redis_duration_s":0.002559,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00108,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001479,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013544,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021193,"completed_at":"2026-08-29T13:43:07.276Z","load_balancing_strategy":"primary","db_duration_s":0.002642,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1280gitlab # [ 240.715990] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.278Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e880c263b5ac23d9537ca7ca","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e880c263b5ac23d9537ca7ca: start","job_status":"start","queue_duration_s":0.635551,"scheduling_latency_s":0.635569}1281gitlab # [ 240.728560] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.302Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e880c263b5ac23d9537ca7ca","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e880c263b5ac23d9537ca7ca: done: 0.023721 sec","job_status":"done","queue_duration_s":0.635551,"scheduling_latency_s":0.635569,"redis_calls":16,"redis_duration_s":0.004008,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000725,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001103,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00218,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014019,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031416,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023721,"completed_at":"2026-08-29T13:43:07.302Z","load_balancing_strategy":"primary","db_duration_s":0.000694,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1282gitlab # [ 240.770540] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.303Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"66c58e5bc8a9e1f521b81bc6","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-66c58e5bc8a9e1f521b81bc6: start","job_status":"start","queue_duration_s":0.660906,"scheduling_latency_s":0.660923}1283gitlab # [ 240.783210] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.320Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"66c58e5bc8a9e1f521b81bc6","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-66c58e5bc8a9e1f521b81bc6: done: 0.016427 sec","job_status":"done","queue_duration_s":0.660906,"scheduling_latency_s":0.660923,"redis_calls":13,"redis_duration_s":0.00275,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000951,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001799,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010344,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016427,"completed_at":"2026-08-29T13:43:07.320Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1284gitlab # [ 240.823180] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.322Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64360a683ea7e7ed0bd0e0e9","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64360a683ea7e7ed0bd0e0e9: start","job_status":"start","queue_duration_s":0.679294,"scheduling_latency_s":0.67931}1285gitlab # [ 240.835938] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.338Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64360a683ea7e7ed0bd0e0e9","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64360a683ea7e7ed0bd0e0e9: done: 0.016624 sec","job_status":"done","queue_duration_s":0.679294,"scheduling_latency_s":0.67931,"redis_calls":13,"redis_duration_s":0.0032579999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00105,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002208,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010453,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016624,"completed_at":"2026-08-29T13:43:07.338Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1286gitlab # [ 240.875945] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.340Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f72846448c07f8e3d761875","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f72846448c07f8e3d761875: start","job_status":"start","queue_duration_s":0.697494,"scheduling_latency_s":0.697511}1287gitlab # [ 240.888782] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.356Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f72846448c07f8e3d761875","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f72846448c07f8e3d761875: done: 0.016438 sec","job_status":"done","queue_duration_s":0.697494,"scheduling_latency_s":0.697511,"redis_calls":13,"redis_duration_s":0.0032920000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000974,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002318,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010194,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016438,"completed_at":"2026-08-29T13:43:07.356Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1288gitlab # [ 240.929727] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.358Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf1534752176e27c5536eba0","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf1534752176e27c5536eba0: start","job_status":"start","queue_duration_s":0.715615,"scheduling_latency_s":0.715631}1289gitlab # [ 240.942252] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.374Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf1534752176e27c5536eba0","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf1534752176e27c5536eba0: done: 0.015905 sec","job_status":"done","queue_duration_s":0.715615,"scheduling_latency_s":0.715631,"redis_calls":13,"redis_duration_s":0.0027340000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000938,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001796,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010234,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015905,"completed_at":"2026-08-29T13:43:07.374Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1290gitlab # [ 240.981464] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.376Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"faa933d508a371aa7679fec1","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-faa933d508a371aa7679fec1: start","job_status":"start","queue_duration_s":0.733522,"scheduling_latency_s":0.73354}1291gitlab # [ 240.994010] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.392Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"faa933d508a371aa7679fec1","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-faa933d508a371aa7679fec1: done: 0.015888 sec","job_status":"done","queue_duration_s":0.733522,"scheduling_latency_s":0.73354,"redis_calls":13,"redis_duration_s":0.002802,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000936,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001866,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010058,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015888,"completed_at":"2026-08-29T13:43:07.392Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1292gitlab # [ 241.033372] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.393Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"168cbab766862a5e6623a1b6","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-168cbab766862a5e6623a1b6: start","job_status":"start","queue_duration_s":0.75089,"scheduling_latency_s":0.750907}1293gitlab # [ 241.045794] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.409Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"168cbab766862a5e6623a1b6","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-168cbab766862a5e6623a1b6: done: 0.016075 sec","job_status":"done","queue_duration_s":0.75089,"scheduling_latency_s":0.750907,"redis_calls":13,"redis_duration_s":0.002829,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000934,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001895,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010138,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016075,"completed_at":"2026-08-29T13:43:07.409Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1294gitlab # [ 241.084795] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.411Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1eb03c82320dc4c5c715a78a","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1eb03c82320dc4c5c715a78a: start","job_status":"start","queue_duration_s":0.768364,"scheduling_latency_s":0.76838}1295gitlab # [ 241.097224] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.427Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1eb03c82320dc4c5c715a78a","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1eb03c82320dc4c5c715a78a: done: 0.01601 sec","job_status":"done","queue_duration_s":0.768364,"scheduling_latency_s":0.76838,"redis_calls":13,"redis_duration_s":0.002751,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000952,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001799,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009888,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01601,"completed_at":"2026-08-29T13:43:07.427Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1296gitlab # [ 241.137707] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.429Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"855d312a78208a64b30b2e30","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-855d312a78208a64b30b2e30: start","job_status":"start","queue_duration_s":0.786271,"scheduling_latency_s":0.786288}1297gitlab # [ 241.150170] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.445Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"855d312a78208a64b30b2e30","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-855d312a78208a64b30b2e30: done: 0.015948 sec","job_status":"done","queue_duration_s":0.786271,"scheduling_latency_s":0.786288,"redis_calls":13,"redis_duration_s":0.002819,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00096,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001859,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009745,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015948,"completed_at":"2026-08-29T13:43:07.445Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1298gitlab # [ 241.189235] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.446Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8b9422a60510b4f1ef72707b","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8b9422a60510b4f1ef72707b: start","job_status":"start","queue_duration_s":0.803662,"scheduling_latency_s":0.803679}1299gitlab # [ 241.201682] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.462Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8b9422a60510b4f1ef72707b","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8b9422a60510b4f1ef72707b: done: 0.015932 sec","job_status":"done","queue_duration_s":0.803662,"scheduling_latency_s":0.803679,"redis_calls":13,"redis_duration_s":0.0028510000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000933,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001918,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009858,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015932,"completed_at":"2026-08-29T13:43:07.462Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1300gitlab # [ 241.241443] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.463Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f4de10e0f093ac7f2048962b","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f4de10e0f093ac7f2048962b: start","job_status":"start","queue_duration_s":0.820963,"scheduling_latency_s":0.820979}1301gitlab # [ 241.254086] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.479Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f4de10e0f093ac7f2048962b","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f4de10e0f093ac7f2048962b: done: 0.015553 sec","job_status":"done","queue_duration_s":0.820963,"scheduling_latency_s":0.820979,"redis_calls":13,"redis_duration_s":0.0026939999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000963,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001731,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00983,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015553,"completed_at":"2026-08-29T13:43:07.479Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1302gitlab # [ 241.294161] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.481Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e5f4c3fd49c1e6b755c6f69d","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e5f4c3fd49c1e6b755c6f69d: start","job_status":"start","queue_duration_s":0.838096,"scheduling_latency_s":0.838113}1303gitlab # [ 241.306866] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.496Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e5f4c3fd49c1e6b755c6f69d","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e5f4c3fd49c1e6b755c6f69d: done: 0.015818 sec","job_status":"done","queue_duration_s":0.838096,"scheduling_latency_s":0.838113,"redis_calls":13,"redis_duration_s":0.002728,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000935,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001793,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009605,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015818,"completed_at":"2026-08-29T13:43:07.496Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1304gitlab # [ 241.348167] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.498Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"12e5748d711bb2b9f87070a5","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-12e5748d711bb2b9f87070a5: start","job_status":"start","queue_duration_s":0.855389,"scheduling_latency_s":0.855406}1305gitlab # [ 241.360678] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.514Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"12e5748d711bb2b9f87070a5","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-12e5748d711bb2b9f87070a5: done: 0.015971 sec","job_status":"done","queue_duration_s":0.855389,"scheduling_latency_s":0.855406,"redis_calls":13,"redis_duration_s":0.0028580000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00102,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001838,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010253,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015971,"completed_at":"2026-08-29T13:43:07.514Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1306gitlab # [ 241.400331] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.515Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f39975383d3bc04a0cd90921","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f39975383d3bc04a0cd90921: start","job_status":"start","queue_duration_s":0.872875,"scheduling_latency_s":0.872892}1307gitlab # [ 241.412673] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.531Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f39975383d3bc04a0cd90921","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f39975383d3bc04a0cd90921: done: 0.016083 sec","job_status":"done","queue_duration_s":0.872875,"scheduling_latency_s":0.872892,"redis_calls":13,"redis_duration_s":0.003204,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00094,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002264,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010026,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016083,"completed_at":"2026-08-29T13:43:07.531Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1308gitlab # [ 241.452550] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.533Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5774dd918f344dbd900c7e63","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5774dd918f344dbd900c7e63: start","job_status":"start","queue_duration_s":0.890436,"scheduling_latency_s":0.890452}1309gitlab # [ 241.464964] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.548Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5774dd918f344dbd900c7e63","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5774dd918f344dbd900c7e63: done: 0.015445 sec","job_status":"done","queue_duration_s":0.890436,"scheduling_latency_s":0.890452,"redis_calls":13,"redis_duration_s":0.002709,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000923,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001786,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009901,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015445,"completed_at":"2026-08-29T13:43:07.548Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1310gitlab # [ 241.504194] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.550Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0f61ea4e832aabefba8da84d","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0f61ea4e832aabefba8da84d: start","job_status":"start","queue_duration_s":0.907622,"scheduling_latency_s":0.907639}1311gitlab # [ 241.516503] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.565Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0f61ea4e832aabefba8da84d","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0f61ea4e832aabefba8da84d: done: 0.015247 sec","job_status":"done","queue_duration_s":0.907622,"scheduling_latency_s":0.907639,"redis_calls":13,"redis_duration_s":0.002661,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001083,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001578,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009831,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015247,"completed_at":"2026-08-29T13:43:07.565Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1312gitlab # [ 241.556646] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.567Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff4f6453d6e176f5c2c41f21","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff4f6453d6e176f5c2c41f21: start","job_status":"start","queue_duration_s":0.924289,"scheduling_latency_s":0.924305}1313gitlab # [ 241.568778] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.582Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff4f6453d6e176f5c2c41f21","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff4f6453d6e176f5c2c41f21: done: 0.015626 sec","job_status":"done","queue_duration_s":0.924289,"scheduling_latency_s":0.924305,"redis_calls":13,"redis_duration_s":0.002692,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000909,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001783,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009871,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015626,"completed_at":"2026-08-29T13:43:07.582Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1314gitlab # [ 241.608278] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.584Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5be31672975aab821beb13a9","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5be31672975aab821beb13a9: start","job_status":"start","queue_duration_s":0.941271,"scheduling_latency_s":0.941288}1315gitlab # [ 241.620573] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.600Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5be31672975aab821beb13a9","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5be31672975aab821beb13a9: done: 0.01587 sec","job_status":"done","queue_duration_s":0.941271,"scheduling_latency_s":0.941288,"redis_calls":13,"redis_duration_s":0.002895,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000937,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001958,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010076,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01587,"completed_at":"2026-08-29T13:43:07.599Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1316gitlab # [ 241.659674] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.601Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1d2e826624b4a4e29918b634","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1d2e826624b4a4e29918b634: start","job_status":"start","queue_duration_s":0.958713,"scheduling_latency_s":0.95873}1317gitlab # [ 241.672395] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.617Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1d2e826624b4a4e29918b634","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1d2e826624b4a4e29918b634: done: 0.015936 sec","job_status":"done","queue_duration_s":0.958713,"scheduling_latency_s":0.95873,"redis_calls":13,"redis_duration_s":0.002536,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000797,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001739,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010114,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015936,"completed_at":"2026-08-29T13:43:07.617Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1318gitlab # [ 241.711704] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.618Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"024e19a9d3f183b6cecdbfe5","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-024e19a9d3f183b6cecdbfe5: start","job_status":"start","queue_duration_s":0.975837,"scheduling_latency_s":0.975853}1319gitlab # [ 241.724348] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.634Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"024e19a9d3f183b6cecdbfe5","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-024e19a9d3f183b6cecdbfe5: done: 0.015702 sec","job_status":"done","queue_duration_s":0.975837,"scheduling_latency_s":0.975853,"redis_calls":13,"redis_duration_s":0.0017620000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000553,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001209,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010496,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015702,"completed_at":"2026-08-29T13:43:07.634Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1320gitlab # [ 241.764544] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.635Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3785aea06aa6e4e73e9d514","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3785aea06aa6e4e73e9d514: start","job_status":"start","queue_duration_s":0.992674,"scheduling_latency_s":0.99269}1321gitlab # [ 241.776890] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.650Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3785aea06aa6e4e73e9d514","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3785aea06aa6e4e73e9d514: done: 0.015367 sec","job_status":"done","queue_duration_s":0.992674,"scheduling_latency_s":0.99269,"redis_calls":13,"redis_duration_s":0.001612,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00057,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001042,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010527,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015367,"completed_at":"2026-08-29T13:43:07.650Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1322gitlab # [ 241.816370] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.652Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4416de853e6ed320cf016d43","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4416de853e6ed320cf016d43: start","job_status":"start","queue_duration_s":1.00931,"scheduling_latency_s":1.009326}1323gitlab # [ 241.828714] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.667Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4416de853e6ed320cf016d43","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4416de853e6ed320cf016d43: done: 0.014936 sec","job_status":"done","queue_duration_s":1.00931,"scheduling_latency_s":1.009326,"redis_calls":13,"redis_duration_s":0.0015,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000547,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000953,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010161,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014936,"completed_at":"2026-08-29T13:43:07.667Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1324gitlab # [ 241.867873] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.668Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d69eb469390259371acc041","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d69eb469390259371acc041: start","job_status":"start","queue_duration_s":1.025506,"scheduling_latency_s":1.025523}1325gitlab # [ 241.880526] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.683Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d69eb469390259371acc041","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d69eb469390259371acc041: done: 0.014856 sec","job_status":"done","queue_duration_s":1.025506,"scheduling_latency_s":1.025523,"redis_calls":13,"redis_duration_s":0.001545,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000557,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000988,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01044,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014856,"completed_at":"2026-08-29T13:43:07.683Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1326gitlab # [ 241.920027] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.684Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"48ca11b86b7af26a6032d4a7","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-48ca11b86b7af26a6032d4a7: start","job_status":"start","queue_duration_s":1.041599,"scheduling_latency_s":1.041616}1327gitlab # [ 241.933445] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.699Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"48ca11b86b7af26a6032d4a7","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-48ca11b86b7af26a6032d4a7: done: 0.014957 sec","job_status":"done","queue_duration_s":1.041599,"scheduling_latency_s":1.041616,"redis_calls":13,"redis_duration_s":0.001622,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000588,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001034,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010469,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014957,"completed_at":"2026-08-29T13:43:07.699Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1328gitlab # [ 241.972682] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.700Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aba0ef4813af689c2827ec1a","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aba0ef4813af689c2827ec1a: start","job_status":"start","queue_duration_s":1.057809,"scheduling_latency_s":1.057826}1329gitlab # [ 241.984892] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.715Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aba0ef4813af689c2827ec1a","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aba0ef4813af689c2827ec1a: done: 0.015128 sec","job_status":"done","queue_duration_s":1.057809,"scheduling_latency_s":1.057826,"redis_calls":13,"redis_duration_s":0.001511,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000962,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010474,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015128,"completed_at":"2026-08-29T13:43:07.715Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1330gitlab # [ 242.024121] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.717Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b03752c46722a29421235b5","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b03752c46722a29421235b5: start","job_status":"start","queue_duration_s":1.074245,"scheduling_latency_s":1.074262}1331gitlab # [ 242.036282] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.732Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b03752c46722a29421235b5","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b03752c46722a29421235b5: done: 0.01536 sec","job_status":"done","queue_duration_s":1.074245,"scheduling_latency_s":1.074262,"redis_calls":13,"redis_duration_s":0.0018020000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000808,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000994,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0107,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01536,"completed_at":"2026-08-29T13:43:07.732Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1332gitlab # [ 242.075398] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.733Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a948ba31776758a4bb69f022","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a948ba31776758a4bb69f022: start","job_status":"start","queue_duration_s":1.090774,"scheduling_latency_s":1.090792}1333gitlab # [ 242.088287] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.748Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a948ba31776758a4bb69f022","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a948ba31776758a4bb69f022: done: 0.014865 sec","job_status":"done","queue_duration_s":1.090774,"scheduling_latency_s":1.090792,"redis_calls":13,"redis_duration_s":0.001592,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001064,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010287,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014865,"completed_at":"2026-08-29T13:43:07.748Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1334gitlab # [ 242.128550] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.749Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d0e2a75c1f8cea436cc3268","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d0e2a75c1f8cea436cc3268: start","job_status":"start","queue_duration_s":1.106719,"scheduling_latency_s":1.106735}1335gitlab # [ 242.165929] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.764Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d0e2a75c1f8cea436cc3268","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d0e2a75c1f8cea436cc3268: done: 0.014749 sec","job_status":"done","queue_duration_s":1.106719,"scheduling_latency_s":1.106735,"redis_calls":13,"redis_duration_s":0.0016430000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001128,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010289,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014749,"completed_at":"2026-08-29T13:43:07.764Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1336gitlab # [ 242.249024] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.765Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d1fcce8e2cac86b5c86ca127","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d1fcce8e2cac86b5c86ca127: start","job_status":"start","queue_duration_s":1.12272,"scheduling_latency_s":1.122736}1337gitlab # [ 242.264415] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.780Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d1fcce8e2cac86b5c86ca127","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d1fcce8e2cac86b5c86ca127: done: 0.015168 sec","job_status":"done","queue_duration_s":1.12272,"scheduling_latency_s":1.122736,"redis_calls":13,"redis_duration_s":0.001824,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000714,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00111,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0105,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015168,"completed_at":"2026-08-29T13:43:07.780Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1338gitlab # [ 242.307817] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.781Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91cbe7cc00301874c35827dd","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91cbe7cc00301874c35827dd: start","job_status":"start","queue_duration_s":1.13897,"scheduling_latency_s":1.138986}1339gitlab # [ 242.320345] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.796Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91cbe7cc00301874c35827dd","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91cbe7cc00301874c35827dd: done: 0.014953 sec","job_status":"done","queue_duration_s":1.13897,"scheduling_latency_s":1.138986,"redis_calls":13,"redis_duration_s":0.001549,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000562,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000987,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01024,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014953,"completed_at":"2026-08-29T13:43:07.796Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1340gitlab # [ 242.359937] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.797Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0db88f7184a4abe90026126f","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0db88f7184a4abe90026126f: start","job_status":"start","queue_duration_s":1.155059,"scheduling_latency_s":1.155076}1341gitlab # [ 242.373676] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.812Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0db88f7184a4abe90026126f","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0db88f7184a4abe90026126f: done: 0.014713 sec","job_status":"done","queue_duration_s":1.155059,"scheduling_latency_s":1.155076,"redis_calls":13,"redis_duration_s":0.001526,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000575,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000951,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010191,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014713,"completed_at":"2026-08-29T13:43:07.812Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1342gitlab # [ 242.412632] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.814Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81bab75a951837b1885c0a71","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81bab75a951837b1885c0a71: start","job_status":"start","queue_duration_s":1.17124,"scheduling_latency_s":1.171261}1343gitlab # [ 242.424989] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.829Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81bab75a951837b1885c0a71","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81bab75a951837b1885c0a71: done: 0.015256 sec","job_status":"done","queue_duration_s":1.17124,"scheduling_latency_s":1.171261,"redis_calls":13,"redis_duration_s":0.0015249999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000558,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000967,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01042,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015256,"completed_at":"2026-08-29T13:43:07.829Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1344gitlab # [ 242.464136] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.830Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3dfa12fa5cba4d00a38e23c3","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3dfa12fa5cba4d00a38e23c3: start","job_status":"start","queue_duration_s":1.187973,"scheduling_latency_s":1.18799}1345gitlab # [ 242.476521] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.845Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3dfa12fa5cba4d00a38e23c3","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3dfa12fa5cba4d00a38e23c3: done: 0.014913 sec","job_status":"done","queue_duration_s":1.187973,"scheduling_latency_s":1.18799,"redis_calls":13,"redis_duration_s":0.001496,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000557,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000939,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010469,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014913,"completed_at":"2026-08-29T13:43:07.845Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1346gitlab # [ 242.515659] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.847Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e1b5119643d38a0cdee1b838","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e1b5119643d38a0cdee1b838: start","job_status":"start","queue_duration_s":1.204132,"scheduling_latency_s":1.204149}1347gitlab # [ 242.528092] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.861Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e1b5119643d38a0cdee1b838","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e1b5119643d38a0cdee1b838: done: 0.01459 sec","job_status":"done","queue_duration_s":1.204132,"scheduling_latency_s":1.204149,"redis_calls":13,"redis_duration_s":0.001454,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000929,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010302,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01459,"completed_at":"2026-08-29T13:43:07.861Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1348gitlab # [ 242.567112] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.862Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"96fd5b52ae48eaf06ba4433a","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-96fd5b52ae48eaf06ba4433a: start","job_status":"start","queue_duration_s":1.219976,"scheduling_latency_s":1.219992}1349gitlab # [ 242.580758] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.877Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"96fd5b52ae48eaf06ba4433a","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-96fd5b52ae48eaf06ba4433a: done: 0.015019 sec","job_status":"done","queue_duration_s":1.219976,"scheduling_latency_s":1.219992,"redis_calls":13,"redis_duration_s":0.0014780000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000947,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010509,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015019,"completed_at":"2026-08-29T13:43:07.877Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1350gitlab # [ 242.620240] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.879Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fefde65ecfa12b688ef76662","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fefde65ecfa12b688ef76662: start","job_status":"start","queue_duration_s":1.236276,"scheduling_latency_s":1.236293}1351gitlab # [ 242.632441] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.893Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fefde65ecfa12b688ef76662","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fefde65ecfa12b688ef76662: done: 0.014791 sec","job_status":"done","queue_duration_s":1.236276,"scheduling_latency_s":1.236293,"redis_calls":13,"redis_duration_s":0.001493,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000954,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010409,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014791,"completed_at":"2026-08-29T13:43:07.893Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1352gitlab # [ 242.671354] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.895Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77d764f3a5df484785f2b3b0","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77d764f3a5df484785f2b3b0: start","job_status":"start","queue_duration_s":1.252205,"scheduling_latency_s":1.252222}1353gitlab # [ 242.683689] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.909Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77d764f3a5df484785f2b3b0","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77d764f3a5df484785f2b3b0: done: 0.014844 sec","job_status":"done","queue_duration_s":1.252205,"scheduling_latency_s":1.252222,"redis_calls":13,"redis_duration_s":0.001526,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000558,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000968,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010291,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014844,"completed_at":"2026-08-29T13:43:07.909Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1354gitlab # [ 242.722801] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.911Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"95f7dff3bacae135deb0f386","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-95f7dff3bacae135deb0f386: start","job_status":"start","queue_duration_s":1.268112,"scheduling_latency_s":1.268129}1355gitlab # [ 242.735321] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.926Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"95f7dff3bacae135deb0f386","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-95f7dff3bacae135deb0f386: done: 0.015806 sec","job_status":"done","queue_duration_s":1.268112,"scheduling_latency_s":1.268129,"redis_calls":13,"redis_duration_s":0.00151,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000545,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000965,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010894,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015806,"completed_at":"2026-08-29T13:43:07.926Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1356gitlab # [ 242.774155] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.928Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a02a2edfda74fd0030aac162","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a02a2edfda74fd0030aac162: start","job_status":"start","queue_duration_s":1.285141,"scheduling_latency_s":1.285158}1357gitlab # [ 242.787657] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.943Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a02a2edfda74fd0030aac162","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a02a2edfda74fd0030aac162: done: 0.015589 sec","job_status":"done","queue_duration_s":1.285141,"scheduling_latency_s":1.285158,"redis_calls":13,"redis_duration_s":0.001581,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000588,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000993,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01051,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015589,"completed_at":"2026-08-29T13:43:07.943Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1358gitlab # [ 242.826514] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.944Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"175df2bc69763327a3966a64","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-175df2bc69763327a3966a64: start","job_status":"start","queue_duration_s":1.301794,"scheduling_latency_s":1.301811}1359gitlab # [ 242.839059] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.959Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"175df2bc69763327a3966a64","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-175df2bc69763327a3966a64: done: 0.015025 sec","job_status":"done","queue_duration_s":1.301794,"scheduling_latency_s":1.301811,"redis_calls":13,"redis_duration_s":0.00148,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000945,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010282,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015025,"completed_at":"2026-08-29T13:43:07.959Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1360gitlab # [ 242.878867] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.960Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91858d934f5913a616c70c93","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91858d934f5913a616c70c93: start","job_status":"start","queue_duration_s":1.317905,"scheduling_latency_s":1.317921}1361gitlab # [ 242.891422] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.976Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91858d934f5913a616c70c93","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91858d934f5913a616c70c93: done: 0.015071 sec","job_status":"done","queue_duration_s":1.317905,"scheduling_latency_s":1.317921,"redis_calls":13,"redis_duration_s":0.001464,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01034,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015071,"completed_at":"2026-08-29T13:43:07.975Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1362gitlab # [ 242.930416] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.977Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db591f0b3d380ff8340399d4","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db591f0b3d380ff8340399d4: start","job_status":"start","queue_duration_s":1.334407,"scheduling_latency_s":1.334424}1363gitlab # [ 242.942844] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.992Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db591f0b3d380ff8340399d4","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db591f0b3d380ff8340399d4: done: 0.015058 sec","job_status":"done","queue_duration_s":1.334407,"scheduling_latency_s":1.334424,"redis_calls":13,"redis_duration_s":0.001485,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000556,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000929,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010511,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015058,"completed_at":"2026-08-29T13:43:07.992Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1364gitlab # [ 242.982745] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:07.993Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77b232d6af93162580c4d5a2","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77b232d6af93162580c4d5a2: start","job_status":"start","queue_duration_s":1.350751,"scheduling_latency_s":1.350769}1365gitlab # [ 242.995011] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:08.008Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77b232d6af93162580c4d5a2","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77b232d6af93162580c4d5a2: done: 0.014978 sec","job_status":"done","queue_duration_s":1.350751,"scheduling_latency_s":1.350769,"redis_calls":13,"redis_duration_s":0.0014780000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000943,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010575,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014978,"completed_at":"2026-08-29T13:43:08.008Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1366gitlab # [ 243.035006] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:08.009Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"38deb0696527c3b32aa52276","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-38deb0696527c3b32aa52276: start","job_status":"start","queue_duration_s":1.367037,"scheduling_latency_s":1.367053}1367gitlab # [ 243.047398] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:08.025Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"38deb0696527c3b32aa52276","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-38deb0696527c3b32aa52276: done: 0.015896 sec","job_status":"done","queue_duration_s":1.367037,"scheduling_latency_s":1.367053,"redis_calls":13,"redis_duration_s":0.001736,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000761,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000975,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010999,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015896,"completed_at":"2026-08-29T13:43:08.025Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1368gitlab # [ 243.086260] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:08.027Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2913a1a9f29dadfe33fa688e","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2913a1a9f29dadfe33fa688e: start","job_status":"start","queue_duration_s":1.384337,"scheduling_latency_s":1.384355}1369gitlab # [ 243.098660] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:08.044Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2913a1a9f29dadfe33fa688e","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2913a1a9f29dadfe33fa688e: done: 0.016951 sec","job_status":"done","queue_duration_s":1.384337,"scheduling_latency_s":1.384355,"redis_calls":13,"redis_duration_s":0.001843,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000565,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001278,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011774,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016951,"completed_at":"2026-08-29T13:43:08.044Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1370gitlab # [ 243.137144] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:08.045Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b9bd29fc0add47aec8fdf1ac","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b9bd29fc0add47aec8fdf1ac: start","job_status":"start","queue_duration_s":1.402695,"scheduling_latency_s":1.402713}1371gitlab # [ 243.149309] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:08.060Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b9bd29fc0add47aec8fdf1ac","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b9bd29fc0add47aec8fdf1ac: done: 0.015331 sec","job_status":"done","queue_duration_s":1.402695,"scheduling_latency_s":1.402713,"redis_calls":13,"redis_duration_s":0.001511,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000962,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010952,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015331,"completed_at":"2026-08-29T13:43:08.060Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1372gitlab # [ 243.189134] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:08.062Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"715dd62671e43db1aa373690","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-715dd62671e43db1aa373690: start","job_status":"start","queue_duration_s":1.419232,"scheduling_latency_s":1.419249}1373gitlab # [ 243.201429] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:08.076Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"715dd62671e43db1aa373690","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-715dd62671e43db1aa373690: done: 0.014821 sec","job_status":"done","queue_duration_s":1.419232,"scheduling_latency_s":1.419249,"redis_calls":13,"redis_duration_s":0.001441,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000913,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010286,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014821,"completed_at":"2026-08-29T13:43:08.076Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1374gitlab # [ 243.239959] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:08.078Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4aeea7bf0ce2c89734c71740","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4aeea7bf0ce2c89734c71740: start","job_status":"start","queue_duration_s":1.43516,"scheduling_latency_s":1.435176}1375gitlab # [ 243.252422] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:08.093Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4aeea7bf0ce2c89734c71740","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4aeea7bf0ce2c89734c71740: done: 0.015445 sec","job_status":"done","queue_duration_s":1.43516,"scheduling_latency_s":1.435176,"redis_calls":13,"redis_duration_s":0.001546,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000533,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001013,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010657,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015445,"completed_at":"2026-08-29T13:43:08.093Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1376gitlab # [ 243.291049] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:08.094Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e94d1f12c7c2230e7145963c","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e94d1f12c7c2230e7145963c: start","job_status":"start","queue_duration_s":1.45169,"scheduling_latency_s":1.451706}1377gitlab # [ 243.303448] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:08.109Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e94d1f12c7c2230e7145963c","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e94d1f12c7c2230e7145963c: done: 0.015113 sec","job_status":"done","queue_duration_s":1.45169,"scheduling_latency_s":1.451706,"redis_calls":13,"redis_duration_s":0.001523,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000561,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000962,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010317,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015113,"completed_at":"2026-08-29T13:43:08.109Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1378gitlab # [ 243.343523] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:08.110Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f4256816f1d36b891206047c","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f4256816f1d36b891206047c: start","job_status":"start","queue_duration_s":1.46798,"scheduling_latency_s":1.467997}1379gitlab # [ 243.356334] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:43:08.126Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f4256816f1d36b891206047c","created_at":"2026-08-29T13:43:06.558Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-069f452bb25e4f61","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c088f0e9b0b24ed9a0ad8ed375116802","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:43:06.642Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f4256816f1d36b891206047c: done: 0.015388 sec","job_status":"done","queue_duration_s":1.46798,"scheduling_latency_s":1.467997,"redis_calls":13,"redis_duration_s":0.001576,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00057,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001006,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010491,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015388,"completed_at":"2026-08-29T13:43:08.126Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1380gitlab # [ 275.133617] setup-gitlab-start[2987]: W, [2026-08-29T13:43:41.937013 #2987] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1381gitlab # [ 296.533264] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:03.336Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"541386307a1ec7c55b114226","created_at":"2026-08-29T13:44:03.312Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8da8b744a3fe51bf961a59e6a41b8774","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:03.332Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-541386307a1ec7c55b114226: start","job_status":"start","queue_duration_s":0.00349,"scheduling_latency_s":0.003562}1382gitlab # [ 296.591135] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:03.395Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1383gitlab # [ 296.634081] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:03.437Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"541386307a1ec7c55b114226","created_at":"2026-08-29T13:44:03.312Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8da8b744a3fe51bf961a59e6a41b8774","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:03.332Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-541386307a1ec7c55b114226: done: 0.101899 sec","job_status":"done","queue_duration_s":0.00349,"scheduling_latency_s":0.003562,"redis_calls":14,"redis_duration_s":0.033595,"redis_read_bytes":901,"redis_write_bytes":1285,"redis_feature_flag_calls":7,"redis_feature_flag_duration_s":0.020245,"redis_feature_flag_read_bytes":896,"redis_feature_flag_write_bytes":464,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.010541,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002809,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039024,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.101899,"completed_at":"2026-08-29T13:44:03.437Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1384gitlab # [ 296.721391] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:03.441Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"3ed317935683a1562b9b33c2","created_at":"2026-08-29T13:44:03.356Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"653c4cdb6942a58ef260a2196d41f525","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:03.391Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-3ed317935683a1562b9b33c2: start","job_status":"start","queue_duration_s":0.049779,"scheduling_latency_s":0.049821}1385gitlab # [ 296.764071] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:03.565Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"3ed317935683a1562b9b33c2","created_at":"2026-08-29T13:44:03.356Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"653c4cdb6942a58ef260a2196d41f525","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:03.391Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-3ed317935683a1562b9b33c2: done: 0.124906 sec","job_status":"done","queue_duration_s":0.049779,"scheduling_latency_s":0.049821,"redis_calls":13,"redis_duration_s":0.038221000000000005,"redis_read_bytes":139,"redis_write_bytes":1611,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001294,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":386,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.017205,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.019722,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037884,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00102646,"exclusive_lock_hold_duration_s":0.0229105,"duration_s":0.124906,"completed_at":"2026-08-29T13:44:03.565Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012291,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1386gitlab # [ 296.829843] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:03.571Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"a40c6903a10f84f0f4eec565","created_at":"2026-08-29T13:44:03.415Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"332edf052339f7e748f772d455515a54","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:03.496Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-a40c6903a10f84f0f4eec565: start","job_status":"start","queue_duration_s":0.075019,"scheduling_latency_s":0.075057}1387gitlab # [ 296.846017] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:03.625Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"a40c6903a10f84f0f4eec565","created_at":"2026-08-29T13:44:03.415Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"332edf052339f7e748f772d455515a54","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:03.496Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-a40c6903a10f84f0f4eec565: done: 0.054479 sec","job_status":"done","queue_duration_s":0.075019,"scheduling_latency_s":0.075057,"redis_calls":12,"redis_duration_s":0.003637,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000642,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000622,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00139,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000983,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023036,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00040916,"duration_s":0.054479,"completed_at":"2026-08-29T13:44:03.625Z","load_balancing_strategy":"primary","db_duration_s":0.000593,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1388gitlab # [ 296.889381] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:03.627Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"a46f5ca5532c1974deb9e091","created_at":"2026-08-29T13:44:03.504Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"55b90a0abb897afb312b24c661436eaf","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:03.518Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-a46f5ca5532c1974deb9e091: start","job_status":"start","queue_duration_s":0.10937,"scheduling_latency_s":0.109395}1389gitlab # [ 296.997701] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:03.801Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"a46f5ca5532c1974deb9e091","created_at":"2026-08-29T13:44:03.504Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"55b90a0abb897afb312b24c661436eaf","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:03.518Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-a46f5ca5532c1974deb9e091: done: 0.174316 sec","job_status":"done","queue_duration_s":0.10937,"scheduling_latency_s":0.109395,"redis_calls":7,"redis_duration_s":0.010854,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00906,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001794,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031886,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.174316,"completed_at":"2026-08-29T13:44:03.801Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012829,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1390gitlab # [ 297.077664] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:03.808Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"5d39b53760d49d1a6d732a2c","created_at":"2026-08-29T13:44:03.530Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d9c06482535c5fbc10797d947ef089fc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:03.544Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-5d39b53760d49d1a6d732a2c: start","job_status":"start","queue_duration_s":0.263599,"scheduling_latency_s":0.263635}1391gitlab # [ 297.349743] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:04.153Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"5d39b53760d49d1a6d732a2c","created_at":"2026-08-29T13:44:03.530Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d9c06482535c5fbc10797d947ef089fc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:03.544Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-5d39b53760d49d1a6d732a2c: done: 0.345182 sec","job_status":"done","queue_duration_s":0.263599,"scheduling_latency_s":0.263635,"redis_calls":9,"redis_duration_s":0.019805,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.008605,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.0112,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.085,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.085,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.065686,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0091514,"exclusive_lock_hold_duration_s":0.20779154,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.345182,"completed_at":"2026-08-29T13:44:04.153Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.171677,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392gitlab # [ 297.437491] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:04.157Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"681f87999d6c61d8ab835fe3","created_at":"2026-08-29T13:44:03.553Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c75435321fb90d40eed8b3539ccf1f71","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:03.558Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-681f87999d6c61d8ab835fe3: start","job_status":"start","queue_duration_s":0.598807,"scheduling_latency_s":0.598876}1393gitlab # [ 297.454778] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:04.189Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"681f87999d6c61d8ab835fe3","created_at":"2026-08-29T13:44:03.553Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c75435321fb90d40eed8b3539ccf1f71","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:03.558Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-681f87999d6c61d8ab835fe3: done: 0.032375 sec","job_status":"done","queue_duration_s":0.598807,"scheduling_latency_s":0.598876,"redis_calls":8,"redis_duration_s":0.002715,"redis_read_bytes":133,"redis_write_bytes":901,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000314,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":70,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001738,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000663,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020979,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032375,"completed_at":"2026-08-29T13:44:04.189Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1394gitlab # [ 297.497686] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:04.192Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"58a233363e2066087f919765","created_at":"2026-08-29T13:44:03.623Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c09963c09a120c56d498bfc8a6f67838","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:03.632Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-58a233363e2066087f919765: start","job_status":"start","queue_duration_s":0.560628,"scheduling_latency_s":0.560657}1395gitlab # [ 297.513046] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:04.206Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1396gitlab # [ 297.516042] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:04.215Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"58a233363e2066087f919765","created_at":"2026-08-29T13:44:03.623Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c09963c09a120c56d498bfc8a6f67838","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:03.632Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-58a233363e2066087f919765: done: 0.022618 sec","job_status":"done","queue_duration_s":0.560628,"scheduling_latency_s":0.560657,"redis_calls":7,"redis_duration_s":0.002067,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001488,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000579,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013565,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022618,"completed_at":"2026-08-29T13:44:04.215Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1397gitlab # [ 297.556602] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:04.217Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"e2af2c48a0b28cc94af09364","created_at":"2026-08-29T13:44:03.636Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4ee67b6e3a7004034eb57b9555251cad","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-29T13:44:03.640Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-e2af2c48a0b28cc94af09364: start","job_status":"start","queue_duration_s":0.577096,"scheduling_latency_s":0.577122}1398gitlab # [ 297.569779] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:04.229Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1399gitlab # [ 297.573360] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:04.236Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"e2af2c48a0b28cc94af09364","created_at":"2026-08-29T13:44:03.636Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4ee67b6e3a7004034eb57b9555251cad","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-29T13:44:03.640Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-e2af2c48a0b28cc94af09364: done: 0.019547 sec","job_status":"done","queue_duration_s":0.577096,"scheduling_latency_s":0.577122,"redis_calls":7,"redis_duration_s":0.001992,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00142,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000572,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011753,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019547,"completed_at":"2026-08-29T13:44:04.236Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1400gitlab # [ 297.612657] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:04.239Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"30ba5101db25a0c5280828d5","created_at":"2026-08-29T13:44:03.647Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"296c594838e7d7a1e6836ca20f22180d","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:03.650Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-30ba5101db25a0c5280828d5: start","job_status":"start","queue_duration_s":0.588329,"scheduling_latency_s":0.58835}1401gitlab # [ 297.626848] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:04.263Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"30ba5101db25a0c5280828d5","created_at":"2026-08-29T13:44:03.647Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"296c594838e7d7a1e6836ca20f22180d","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:03.650Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-30ba5101db25a0c5280828d5: done: 0.024627 sec","job_status":"done","queue_duration_s":0.588329,"scheduling_latency_s":0.58835,"redis_calls":9,"redis_duration_s":0.002916,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001565,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001351,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015031,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00066378,"exclusive_lock_hold_duration_s":0.00504334,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.024627,"completed_at":"2026-08-29T13:44:04.263Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002844,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1402gitlab # [ 297.668302] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:04.265Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"7a7a7e4c424d62dcf347b2a0","created_at":"2026-08-29T13:44:03.657Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"077e54aea4a8428f3994324ecef60626","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:03.661Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-7a7a7e4c424d62dcf347b2a0: start","job_status":"start","queue_duration_s":0.604523,"scheduling_latency_s":0.604545}1403gitlab # [ 297.682045] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:04.307Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"7a7a7e4c424d62dcf347b2a0","created_at":"2026-08-29T13:44:03.657Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"077e54aea4a8428f3994324ecef60626","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:03.661Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-7a7a7e4c424d62dcf347b2a0: done: 0.042079 sec","job_status":"done","queue_duration_s":0.604523,"scheduling_latency_s":0.604545,"redis_calls":7,"redis_duration_s":0.002216,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001603,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000613,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014753,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.042079,"completed_at":"2026-08-29T13:44:04.307Z","load_balancing_strategy":"primary","db_duration_s":0.019995,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404gitlab # [ 297.723346] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:04.310Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"30f330520e0cb91139a0ccdc","created_at":"2026-08-29T13:44:03.687Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"82014040f73c3083356d5c4efc7c52aa","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:03.691Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-30f330520e0cb91139a0ccdc: start","job_status":"start","queue_duration_s":0.618511,"scheduling_latency_s":0.618538}1405gitlab # [ 297.737740] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:04.343Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"30f330520e0cb91139a0ccdc","created_at":"2026-08-29T13:44:03.687Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"82014040f73c3083356d5c4efc7c52aa","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:03.691Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-30f330520e0cb91139a0ccdc: done: 0.033516 sec","job_status":"done","queue_duration_s":0.618511,"scheduling_latency_s":0.618538,"redis_calls":10,"redis_duration_s":0.00231,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001366,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000944,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022003,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00868206,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.033516,"completed_at":"2026-08-29T13:44:04.343Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004572,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1406gitlab # [ 297.779932] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:04.345Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"bb86c4b9ef1e708f7106ea66","created_at":"2026-08-29T13:44:03.695Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2538394fcd16bf087f3198f26c3964fc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:03.698Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-bb86c4b9ef1e708f7106ea66: start","job_status":"start","queue_duration_s":0.646937,"scheduling_latency_s":0.646962}1407gitlab # [ 297.793423] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:04.380Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"bb86c4b9ef1e708f7106ea66","created_at":"2026-08-29T13:44:03.695Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2538394fcd16bf087f3198f26c3964fc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:03.698Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-bb86c4b9ef1e708f7106ea66: done: 0.03574 sec","job_status":"done","queue_duration_s":0.646937,"scheduling_latency_s":0.646962,"redis_calls":14,"redis_duration_s":0.002528,"redis_read_bytes":16,"redis_write_bytes":4030,"redis_queues_calls":2,"redis_queues_duration_s":0.000243,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.00173,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000555,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026689,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03574,"completed_at":"2026-08-29T13:44:04.380Z","load_balancing_strategy":"primary","db_duration_s":0.002276,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1408gitlab # [ 297.833811] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:04.382Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"5af729329987043cf99bd989","created_at":"2026-08-29T13:44:03.709Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"63cffa64508c6d6dea6c3de7032a9c18","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:03.713Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-5af729329987043cf99bd989: start","job_status":"start","queue_duration_s":0.669444,"scheduling_latency_s":0.669465}1409gitlab # [ 297.898482] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:04.702Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"5af729329987043cf99bd989","created_at":"2026-08-29T13:44:03.709Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"63cffa64508c6d6dea6c3de7032a9c18","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:03.713Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-5af729329987043cf99bd989: done: 0.320216 sec","job_status":"done","queue_duration_s":0.669444,"scheduling_latency_s":0.669465,"redis_calls":562,"redis_duration_s":0.057120000000000004,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000841,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.056279,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.293753,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.320216,"completed_at":"2026-08-29T13:44:04.702Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1410gitlab # [ 297.940496] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:04.704Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"9ba07d3ec382a4028d264b5c","created_at":"2026-08-29T13:44:03.717Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3408f063b487c8220338ea5a2fec1613","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:03.725Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-9ba07d3ec382a4028d264b5c: start","job_status":"start","queue_duration_s":0.979206,"scheduling_latency_s":0.979228}1411gitlab # [ 297.954834] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:04.736Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"9ba07d3ec382a4028d264b5c","created_at":"2026-08-29T13:44:03.717Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3408f063b487c8220338ea5a2fec1613","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:03.725Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-9ba07d3ec382a4028d264b5c: done: 0.032483 sec","job_status":"done","queue_duration_s":0.979206,"scheduling_latency_s":0.979228,"redis_calls":10,"redis_duration_s":0.0014,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000289,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000824,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000287,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0186,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024268,"duration_s":0.032483,"completed_at":"2026-08-29T13:44:04.736Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007243,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1412gitlab # [ 297.997281] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:04.738Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"59dec319e25975bb8f371710","created_at":"2026-08-29T13:44:03.727Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f3aa670c48f0feff051b792015955a90","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-29T13:44:03.730Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-59dec319e25975bb8f371710: start","job_status":"start","queue_duration_s":1.007817,"scheduling_latency_s":1.007835}1413gitlab # [ 298.010784] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:04.745Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1414gitlab # [ 298.014184] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:04.750Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"59dec319e25975bb8f371710","created_at":"2026-08-29T13:44:03.727Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f3aa670c48f0feff051b792015955a90","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-29T13:44:03.730Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-59dec319e25975bb8f371710: done: 0.012769 sec","job_status":"done","queue_duration_s":1.007817,"scheduling_latency_s":1.007835,"redis_calls":7,"redis_duration_s":0.000945,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000674,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000271,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008331,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012769,"completed_at":"2026-08-29T13:44:04.750Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1415gitlab # [ 298.053771] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:04.751Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"26563929a411f15740c988a5","created_at":"2026-08-29T13:44:03.749Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"58dd9b1c05c7ca0414717a459973d824","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:03.758Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-26563929a411f15740c988a5: start","job_status":"start","queue_duration_s":0.993283,"scheduling_latency_s":0.993298}1416gitlab # [ 298.068759] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:04.759Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1417gitlab # [ 298.071963] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:04.764Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"26563929a411f15740c988a5","created_at":"2026-08-29T13:44:03.749Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"58dd9b1c05c7ca0414717a459973d824","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:03.758Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-26563929a411f15740c988a5: done: 0.012768 sec","job_status":"done","queue_duration_s":0.993283,"scheduling_latency_s":0.993298,"redis_calls":7,"redis_duration_s":0.00098,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00071,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00027,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008383,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012768,"completed_at":"2026-08-29T13:44:04.764Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1418gitlab # [ 298.112940] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:04.765Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"312cd7bede08029c68ffde0c","created_at":"2026-08-29T13:44:03.766Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:03.769Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-312cd7bede08029c68ffde0c: start","job_status":"start","queue_duration_s":0.995887,"scheduling_latency_s":0.995903}1419gitlab # [ 298.127590] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:04.857Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"312cd7bede08029c68ffde0c","created_at":"2026-08-29T13:44:03.766Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:03.769Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-312cd7bede08029c68ffde0c: done: 0.091919 sec","job_status":"done","queue_duration_s":0.995887,"scheduling_latency_s":0.995903,"redis_calls":60,"redis_duration_s":0.008758,"redis_read_bytes":108,"redis_write_bytes":41059,"redis_queues_calls":2,"redis_queues_duration_s":0.000536,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.007821,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000401,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.08343,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.091919,"completed_at":"2026-08-29T13:44:04.857Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1420gitlab # [ 298.168873] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:04.858Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"dfac3797992414b5b9fb92e2","created_at":"2026-08-29T13:44:03.789Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2fb0035ae9075e3ad0613ee1e6f5b6f6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:03.799Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-dfac3797992414b5b9fb92e2: start","job_status":"start","queue_duration_s":1.059085,"scheduling_latency_s":1.059101}1421gitlab # [ 298.183544] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:04.872Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"dfac3797992414b5b9fb92e2","created_at":"2026-08-29T13:44:03.789Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2fb0035ae9075e3ad0613ee1e6f5b6f6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:03.799Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-dfac3797992414b5b9fb92e2: done: 0.013601 sec","job_status":"done","queue_duration_s":1.059085,"scheduling_latency_s":1.059101,"redis_calls":7,"redis_duration_s":0.00093,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000671,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000259,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008685,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013601,"completed_at":"2026-08-29T13:44:04.872Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1422gitlab # [ 298.224563] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:04.873Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"c874d0adb5858da67da47f01","created_at":"2026-08-29T13:44:03.829Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1078c59889a310723a3b29f49a7c7ab2","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:03.834Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-c874d0adb5858da67da47f01: start","job_status":"start","queue_duration_s":1.038597,"scheduling_latency_s":1.038628}1423gitlab # [ 298.238608] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:04.889Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"c874d0adb5858da67da47f01","created_at":"2026-08-29T13:44:03.829Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1078c59889a310723a3b29f49a7c7ab2","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:03.834Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-c874d0adb5858da67da47f01: done: 0.015555 sec","job_status":"done","queue_duration_s":1.038597,"scheduling_latency_s":1.038628,"redis_calls":7,"redis_duration_s":0.000962,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000691,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000271,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009826,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015555,"completed_at":"2026-08-29T13:44:04.889Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001559,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1424gitlab # [ 298.279444] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:04.890Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"2cba95c6e448a802d8129218","created_at":"2026-08-29T13:44:03.886Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"11f312c2ccfb55d73fcbd4d19d052512","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-29T13:44:03.896Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-2cba95c6e448a802d8129218: start","job_status":"start","queue_duration_s":0.993633,"scheduling_latency_s":0.993649}1425gitlab # [ 298.292861] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:04.912Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"2cba95c6e448a802d8129218","created_at":"2026-08-29T13:44:03.886Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"11f312c2ccfb55d73fcbd4d19d052512","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-29T13:44:03.896Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-2cba95c6e448a802d8129218: done: 0.022123 sec","job_status":"done","queue_duration_s":0.993633,"scheduling_latency_s":0.993649,"redis_calls":7,"redis_duration_s":0.001176,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000916,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00026,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014681,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022123,"completed_at":"2026-08-29T13:44:04.912Z","load_balancing_strategy":"primary","db_duration_s":0.002847,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1426gitlab # [ 298.332826] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:04.913Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"c4aacb380cc1a3262c6f9c33","created_at":"2026-08-29T13:44:03.929Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"85724991c8d597becbdf5fbd62a9bcc1","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:03.942Z","job_size_bytes":3,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-c4aacb380cc1a3262c6f9c33: start","job_status":"start","queue_duration_s":0.970769,"scheduling_latency_s":0.970786}1427gitlab # [ 298.346385] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:04.931Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"c4aacb380cc1a3262c6f9c33","created_at":"2026-08-29T13:44:03.929Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"85724991c8d597becbdf5fbd62a9bcc1","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:03.942Z","job_size_bytes":3,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-c4aacb380cc1a3262c6f9c33: done: 0.018403 sec","job_status":"done","queue_duration_s":0.970769,"scheduling_latency_s":0.970786,"redis_calls":10,"redis_duration_s":0.0013180000000000002,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000292,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000738,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000288,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011092,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024232,"duration_s":0.018403,"completed_at":"2026-08-29T13:44:04.931Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00072,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1428gitlab # [ 298.387813] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:04.933Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"67f5c72250b6ed4c57f74fa3","created_at":"2026-08-29T13:44:03.962Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c2bc2d06eef43e05010182d094288a28","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:03.972Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-67f5c72250b6ed4c57f74fa3: start","job_status":"start","queue_duration_s":0.960103,"scheduling_latency_s":0.960118}1429gitlab # [ 298.402415] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.017Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"67f5c72250b6ed4c57f74fa3","created_at":"2026-08-29T13:44:03.962Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c2bc2d06eef43e05010182d094288a28","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:03.972Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-67f5c72250b6ed4c57f74fa3: done: 0.084663 sec","job_status":"done","queue_duration_s":0.960103,"scheduling_latency_s":0.960118,"redis_calls":28,"redis_duration_s":0.003778,"redis_read_bytes":36,"redis_write_bytes":10573,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000576,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":680,"redis_queues_calls":2,"redis_queues_duration_s":0.00028,"redis_queues_read_bytes":3,"redis_queues_write_bytes":8285,"redis_queues_metadata_calls":16,"redis_queues_metadata_duration_s":0.002179,"redis_queues_metadata_read_bytes":24,"redis_queues_metadata_write_bytes":1162,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000743,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":446,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.053515,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025488,"duration_s":0.084663,"completed_at":"2026-08-29T13:44:05.017Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.024597,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1430gitlab # [ 298.445557] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.018Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"d1998e34f85944cf48e4ebc7","created_at":"2026-08-29T13:44:04.013Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"174ff824f9d29a098460d4e771b16018","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.021Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-d1998e34f85944cf48e4ebc7: start","job_status":"start","queue_duration_s":0.997628,"scheduling_latency_s":0.997645}1431gitlab # [ 298.459970] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.066Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"d1998e34f85944cf48e4ebc7","created_at":"2026-08-29T13:44:04.013Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"174ff824f9d29a098460d4e771b16018","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.021Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-d1998e34f85944cf48e4ebc7: done: 0.047331 sec","job_status":"done","queue_duration_s":0.997628,"scheduling_latency_s":0.997645,"redis_calls":9,"redis_duration_s":0.0013579999999999998,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000712,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000646,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017885,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00050472,"exclusive_lock_hold_duration_s":0.02425364,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.047331,"completed_at":"2026-08-29T13:44:05.066Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.025823,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1432gitlab # [ 298.502917] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.067Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"57de791b3d6607fc2b16588c","created_at":"2026-08-29T13:44:04.031Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4acde9d99764f488fda0ba00734b94c4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.034Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-57de791b3d6607fc2b16588c: start","job_status":"start","queue_duration_s":1.033215,"scheduling_latency_s":1.033235}1433gitlab # [ 298.524334] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.328Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"57de791b3d6607fc2b16588c","created_at":"2026-08-29T13:44:04.031Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4acde9d99764f488fda0ba00734b94c4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.034Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-57de791b3d6607fc2b16588c: done: 0.261358 sec","job_status":"done","queue_duration_s":1.033215,"scheduling_latency_s":1.033235,"redis_calls":11,"redis_duration_s":0.0017339999999999999,"redis_read_bytes":9,"redis_write_bytes":1262,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000308,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":275,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000772,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000654,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.049,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":130,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.049,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.183616,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00047752,"exclusive_lock_hold_duration_s":0.22980746,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.261358,"completed_at":"2026-08-29T13:44:05.328Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.075328,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1434gitlab # [ 298.569853] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.330Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"ff6d6005adf7d555bfb288c0","created_at":"2026-08-29T13:44:04.060Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"579af2b14be11d60447b96d7e5963155","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.065Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-ff6d6005adf7d555bfb288c0: start","job_status":"start","queue_duration_s":1.264502,"scheduling_latency_s":1.26452}1435gitlab # [ 298.584225] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.338Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1436gitlab # [ 298.587638] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.343Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"ff6d6005adf7d555bfb288c0","created_at":"2026-08-29T13:44:04.060Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"579af2b14be11d60447b96d7e5963155","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.065Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-ff6d6005adf7d555bfb288c0: done: 0.013128 sec","job_status":"done","queue_duration_s":1.264502,"scheduling_latency_s":1.26452,"redis_calls":7,"redis_duration_s":0.0016790000000000002,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001208,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000471,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007838,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013128,"completed_at":"2026-08-29T13:44:05.343Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1437gitlab # [ 298.627961] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.345Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"39a63a77813aaf5ad852b53d","created_at":"2026-08-29T13:44:04.100Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b58852188b89110210b429bfadcecd41","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.108Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-39a63a77813aaf5ad852b53d: start","job_status":"start","queue_duration_s":1.236184,"scheduling_latency_s":1.236201}1438gitlab # [ 298.641398] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.362Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"39a63a77813aaf5ad852b53d","created_at":"2026-08-29T13:44:04.100Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-dafa51a8f5174e2a","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b58852188b89110210b429bfadcecd41","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.108Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-39a63a77813aaf5ad852b53d: done: 0.01737 sec","job_status":"done","queue_duration_s":1.236184,"scheduling_latency_s":1.236201,"redis_calls":9,"redis_duration_s":0.002375,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001228,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001147,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010357,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00053174,"exclusive_lock_hold_duration_s":0.00373388,"duration_s":0.01737,"completed_at":"2026-08-29T13:44:05.362Z","load_balancing_strategy":"primary","db_duration_s":0.001609,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1439gitlab # [ 298.680874] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.363Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"04adaec44a24f90bd4dcb30f","created_at":"2026-08-29T13:44:04.361Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-9f5a0e0225344c21","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2538394fcd16bf087f3198f26c3964fc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.374Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-04adaec44a24f90bd4dcb30f: start","job_status":"start","queue_duration_s":0.989494,"scheduling_latency_s":0.98951}1440gitlab # [ 298.692934] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.375Z","message":"No existing merge request to be cleaned up."}1441gitlab # [ 298.694551] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.384Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"04adaec44a24f90bd4dcb30f","created_at":"2026-08-29T13:44:04.361Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-9f5a0e0225344c21","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2538394fcd16bf087f3198f26c3964fc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.374Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-04adaec44a24f90bd4dcb30f: done: 0.020494 sec","job_status":"done","queue_duration_s":0.989494,"scheduling_latency_s":0.98951,"redis_calls":10,"redis_duration_s":0.0024990000000000004,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001448,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012862,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020494,"completed_at":"2026-08-29T13:44:05.384Z","load_balancing_strategy":"primary","db_duration_s":0.002777,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1442gitlab # [ 298.734066] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.385Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9493e80b990136938254f548","created_at":"2026-08-29T13:44:04.361Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-9f5a0e0225344c21","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2538394fcd16bf087f3198f26c3964fc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.374Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9493e80b990136938254f548: start","job_status":"start","queue_duration_s":1.0114,"scheduling_latency_s":1.011416}1443gitlab # [ 298.746870] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.396Z","message":"No existing merge request to be cleaned up."}1444gitlab # [ 298.748718] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.415Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9493e80b990136938254f548","created_at":"2026-08-29T13:44:04.361Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-9f5a0e0225344c21","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2538394fcd16bf087f3198f26c3964fc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.374Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9493e80b990136938254f548: done: 0.029967 sec","job_status":"done","queue_duration_s":1.0114,"scheduling_latency_s":1.011416,"redis_calls":10,"redis_duration_s":0.0029040000000000003,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001381,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001523,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020434,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029967,"completed_at":"2026-08-29T13:44:05.415Z","load_balancing_strategy":"primary","db_duration_s":0.002699,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1445gitlab # [ 298.788246] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.418Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8491fec96c5050e92c8e0068","created_at":"2026-08-29T13:44:04.361Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-9f5a0e0225344c21","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2538394fcd16bf087f3198f26c3964fc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.374Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8491fec96c5050e92c8e0068: start","job_status":"start","queue_duration_s":1.044422,"scheduling_latency_s":1.044462}1446gitlab # [ 298.800407] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.443Z","message":"No existing merge request to be cleaned up."}1447gitlab # [ 298.802053] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.460Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8491fec96c5050e92c8e0068","created_at":"2026-08-29T13:44:04.361Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-9f5a0e0225344c21","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2538394fcd16bf087f3198f26c3964fc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.374Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8491fec96c5050e92c8e0068: done: 0.041748 sec","job_status":"done","queue_duration_s":1.044422,"scheduling_latency_s":1.044462,"redis_calls":10,"redis_duration_s":0.003099,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001335,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001764,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029891,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.041748,"completed_at":"2026-08-29T13:44:05.460Z","load_balancing_strategy":"primary","db_duration_s":0.002965,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1448gitlab # [ 298.840224] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.463Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c6abd0cb8d1e8416df139fbc","created_at":"2026-08-29T13:44:04.361Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-9f5a0e0225344c21","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2538394fcd16bf087f3198f26c3964fc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.374Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c6abd0cb8d1e8416df139fbc: start","job_status":"start","queue_duration_s":1.088601,"scheduling_latency_s":1.088633}1449gitlab # [ 298.852457] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.483Z","message":"No existing merge request to be cleaned up."}1450gitlab # [ 298.854126] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.497Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c6abd0cb8d1e8416df139fbc","created_at":"2026-08-29T13:44:04.361Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-9f5a0e0225344c21","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2538394fcd16bf087f3198f26c3964fc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.374Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c6abd0cb8d1e8416df139fbc: done: 0.034711 sec","job_status":"done","queue_duration_s":1.088601,"scheduling_latency_s":1.088633,"redis_calls":10,"redis_duration_s":0.002646,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001214,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001432,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02427,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034711,"completed_at":"2026-08-29T13:44:05.497Z","load_balancing_strategy":"primary","db_duration_s":0.002848,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1451gitlab # [ 298.893655] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.499Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5243eadab40bdf6315046325","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5243eadab40bdf6315046325: start","job_status":"start","queue_duration_s":0.64879,"scheduling_latency_s":0.648822}1452gitlab # [ 298.906497] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.524Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5243eadab40bdf6315046325","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5243eadab40bdf6315046325: done: 0.024329 sec","job_status":"done","queue_duration_s":0.64879,"scheduling_latency_s":0.648822,"redis_calls":13,"redis_duration_s":0.002295,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000819,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001476,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016231,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024329,"completed_at":"2026-08-29T13:44:05.523Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1453gitlab # [ 298.946709] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.525Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"74e6d099f9463c62b1284716","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-74e6d099f9463c62b1284716: start","job_status":"start","queue_duration_s":0.674674,"scheduling_latency_s":0.674701}1454gitlab # [ 298.959293] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.544Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"74e6d099f9463c62b1284716","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-74e6d099f9463c62b1284716: done: 0.019219 sec","job_status":"done","queue_duration_s":0.674674,"scheduling_latency_s":0.674701,"redis_calls":13,"redis_duration_s":0.002196,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000694,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001502,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013145,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019219,"completed_at":"2026-08-29T13:44:05.544Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1455gitlab # [ 298.998573] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.546Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d503a9c79c58112df0c91490","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d503a9c79c58112df0c91490: start","job_status":"start","queue_duration_s":0.695211,"scheduling_latency_s":0.695235}1456gitlab # [ 299.011197] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.562Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d503a9c79c58112df0c91490","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d503a9c79c58112df0c91490: done: 0.015919 sec","job_status":"done","queue_duration_s":0.695211,"scheduling_latency_s":0.695235,"redis_calls":13,"redis_duration_s":0.00155,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000567,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000983,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01085,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015919,"completed_at":"2026-08-29T13:44:05.562Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1457gitlab # [ 299.050438] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.563Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d93121a8f6470b31e31668e","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d93121a8f6470b31e31668e: start","job_status":"start","queue_duration_s":0.71227,"scheduling_latency_s":0.712292}1458gitlab # [ 299.062813] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.578Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d93121a8f6470b31e31668e","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d93121a8f6470b31e31668e: done: 0.014941 sec","job_status":"done","queue_duration_s":0.71227,"scheduling_latency_s":0.712292,"redis_calls":13,"redis_duration_s":0.001486,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000958,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010124,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014941,"completed_at":"2026-08-29T13:44:05.578Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1459gitlab # [ 299.102460] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.579Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee7211513e0cfa8e62a40572","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee7211513e0cfa8e62a40572: start","job_status":"start","queue_duration_s":0.7283,"scheduling_latency_s":0.728323}1460gitlab # [ 299.114981] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.593Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee7211513e0cfa8e62a40572","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee7211513e0cfa8e62a40572: done: 0.014085 sec","job_status":"done","queue_duration_s":0.7283,"scheduling_latency_s":0.728323,"redis_calls":13,"redis_duration_s":0.001397,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000885,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009589,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014085,"completed_at":"2026-08-29T13:44:05.593Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1461gitlab # [ 299.155497] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.594Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0155322ae0a23b5d07ddd04","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0155322ae0a23b5d07ddd04: start","job_status":"start","queue_duration_s":0.743454,"scheduling_latency_s":0.743471}1462gitlab # [ 299.168265] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.620Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0155322ae0a23b5d07ddd04","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0155322ae0a23b5d07ddd04: done: 0.026448 sec","job_status":"done","queue_duration_s":0.743454,"scheduling_latency_s":0.743471,"redis_calls":13,"redis_duration_s":0.003828,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001063,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002765,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019262,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026448,"completed_at":"2026-08-29T13:44:05.620Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1463gitlab # [ 299.206942] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.625Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"07393cd5a905187d4d28175b","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-07393cd5a905187d4d28175b: start","job_status":"start","queue_duration_s":0.77426,"scheduling_latency_s":0.774304}1464gitlab # [ 299.219548] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.662Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"07393cd5a905187d4d28175b","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-07393cd5a905187d4d28175b: done: 0.03734 sec","job_status":"done","queue_duration_s":0.77426,"scheduling_latency_s":0.774304,"redis_calls":13,"redis_duration_s":0.004136,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00137,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002766,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025355,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03734,"completed_at":"2026-08-29T13:44:05.662Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1465gitlab # [ 299.258650] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.667Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4c40eb83fde85a6e904c1e33","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4c40eb83fde85a6e904c1e33: start","job_status":"start","queue_duration_s":0.816819,"scheduling_latency_s":0.81686}1466gitlab # [ 299.271242] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.710Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4c40eb83fde85a6e904c1e33","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4c40eb83fde85a6e904c1e33: done: 0.042368 sec","job_status":"done","queue_duration_s":0.816819,"scheduling_latency_s":0.81686,"redis_calls":13,"redis_duration_s":0.006101,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001554,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004547,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022816,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.042368,"completed_at":"2026-08-29T13:44:05.709Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1467gitlab # [ 299.310244] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.712Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1045472581ae3c61b1696dc7","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1045472581ae3c61b1696dc7: start","job_status":"start","queue_duration_s":0.861326,"scheduling_latency_s":0.861357}1468gitlab # [ 299.322677] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.737Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1045472581ae3c61b1696dc7","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1045472581ae3c61b1696dc7: done: 0.025025 sec","job_status":"done","queue_duration_s":0.861326,"scheduling_latency_s":0.861357,"redis_calls":13,"redis_duration_s":0.0034210000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001165,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002256,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01622,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025025,"completed_at":"2026-08-29T13:44:05.737Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1469gitlab # [ 299.362974] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.739Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e1a0a763d7ac288ccc803acb","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e1a0a763d7ac288ccc803acb: start","job_status":"start","queue_duration_s":0.888097,"scheduling_latency_s":0.888118}1470gitlab # [ 299.375356] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.758Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e1a0a763d7ac288ccc803acb","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e1a0a763d7ac288ccc803acb: done: 0.019826 sec","job_status":"done","queue_duration_s":0.888097,"scheduling_latency_s":0.888118,"redis_calls":13,"redis_duration_s":0.0031070000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001044,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002063,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012689,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019826,"completed_at":"2026-08-29T13:44:05.758Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1471gitlab # [ 299.414741] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.760Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0675860c5dfa8a43a82a601","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0675860c5dfa8a43a82a601: start","job_status":"start","queue_duration_s":0.909427,"scheduling_latency_s":0.909446}1472gitlab # [ 299.427149] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.777Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0675860c5dfa8a43a82a601","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0675860c5dfa8a43a82a601: done: 0.017197 sec","job_status":"done","queue_duration_s":0.909427,"scheduling_latency_s":0.909446,"redis_calls":13,"redis_duration_s":0.002865,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000977,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001888,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01085,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017197,"completed_at":"2026-08-29T13:44:05.777Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1473gitlab # [ 299.466358] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.779Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f4ad132fa85fb142082b020","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f4ad132fa85fb142082b020: start","job_status":"start","queue_duration_s":0.928037,"scheduling_latency_s":0.928054}1474gitlab # [ 299.479369] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.794Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f4ad132fa85fb142082b020","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f4ad132fa85fb142082b020: done: 0.015624 sec","job_status":"done","queue_duration_s":0.928037,"scheduling_latency_s":0.928054,"redis_calls":13,"redis_duration_s":0.002765,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000937,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001828,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009671,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015624,"completed_at":"2026-08-29T13:44:05.794Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1475gitlab # [ 299.519294] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.795Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f8db3c956b9704d227d6774","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f8db3c956b9704d227d6774: start","job_status":"start","queue_duration_s":0.945015,"scheduling_latency_s":0.945031}1476gitlab # [ 299.532075] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.812Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f8db3c956b9704d227d6774","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f8db3c956b9704d227d6774: done: 0.016076 sec","job_status":"done","queue_duration_s":0.945015,"scheduling_latency_s":0.945031,"redis_calls":13,"redis_duration_s":0.003261,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000972,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002289,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009929,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016076,"completed_at":"2026-08-29T13:44:05.811Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1477gitlab # [ 299.572815] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.813Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e950aa4b8b3bf9c14801a5a0","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e950aa4b8b3bf9c14801a5a0: start","job_status":"start","queue_duration_s":0.962388,"scheduling_latency_s":0.962404}1478gitlab # [ 299.585337] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.828Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e950aa4b8b3bf9c14801a5a0","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e950aa4b8b3bf9c14801a5a0: done: 0.015081 sec","job_status":"done","queue_duration_s":0.962388,"scheduling_latency_s":0.962404,"redis_calls":13,"redis_duration_s":0.002708,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00091,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001798,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009372,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015081,"completed_at":"2026-08-29T13:44:05.828Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1479gitlab # [ 299.624775] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.829Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c2594ab0eab9ae0398b2b3b","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c2594ab0eab9ae0398b2b3b: start","job_status":"start","queue_duration_s":0.978789,"scheduling_latency_s":0.978805}1480gitlab # [ 299.637052] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.844Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c2594ab0eab9ae0398b2b3b","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c2594ab0eab9ae0398b2b3b: done: 0.014923 sec","job_status":"done","queue_duration_s":0.978789,"scheduling_latency_s":0.978805,"redis_calls":13,"redis_duration_s":0.002672,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000931,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001741,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009321,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014923,"completed_at":"2026-08-29T13:44:05.844Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1481gitlab # [ 299.676461] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.846Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb61816a9d6a417125153338","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb61816a9d6a417125153338: start","job_status":"start","queue_duration_s":0.995051,"scheduling_latency_s":0.995067}1482gitlab # [ 299.688864] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.860Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb61816a9d6a417125153338","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb61816a9d6a417125153338: done: 0.01485 sec","job_status":"done","queue_duration_s":0.995051,"scheduling_latency_s":0.995067,"redis_calls":13,"redis_duration_s":0.002701,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000948,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001753,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009302,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01485,"completed_at":"2026-08-29T13:44:05.860Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1483gitlab # [ 299.728462] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.862Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"93880b88d7e81f30de9a0135","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-93880b88d7e81f30de9a0135: start","job_status":"start","queue_duration_s":1.011291,"scheduling_latency_s":1.011306}1484gitlab # [ 299.740813] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.877Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"93880b88d7e81f30de9a0135","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-93880b88d7e81f30de9a0135: done: 0.014804 sec","job_status":"done","queue_duration_s":1.011291,"scheduling_latency_s":1.011306,"redis_calls":13,"redis_duration_s":0.002734,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000906,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001828,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009219,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014804,"completed_at":"2026-08-29T13:44:05.876Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1485gitlab # [ 299.781264] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.878Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"32ee52146efa1fd5c9bce6b9","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-32ee52146efa1fd5c9bce6b9: start","job_status":"start","queue_duration_s":1.027493,"scheduling_latency_s":1.027508}1486gitlab # [ 299.793903] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.893Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"32ee52146efa1fd5c9bce6b9","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-32ee52146efa1fd5c9bce6b9: done: 0.015105 sec","job_status":"done","queue_duration_s":1.027493,"scheduling_latency_s":1.027508,"redis_calls":13,"redis_duration_s":0.002859,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000969,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00189,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009412,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015105,"completed_at":"2026-08-29T13:44:05.893Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1487gitlab # [ 299.833412] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.894Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de16e98cfaf882585e05edd7","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de16e98cfaf882585e05edd7: start","job_status":"start","queue_duration_s":1.043972,"scheduling_latency_s":1.043987}1488gitlab # [ 299.846016] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.910Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de16e98cfaf882585e05edd7","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de16e98cfaf882585e05edd7: done: 0.01531 sec","job_status":"done","queue_duration_s":1.043972,"scheduling_latency_s":1.043987,"redis_calls":13,"redis_duration_s":0.003027,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001281,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001746,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009396,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01531,"completed_at":"2026-08-29T13:44:05.910Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1489gitlab # [ 299.885515] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.911Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"367848482904cee283b3754d","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-367848482904cee283b3754d: start","job_status":"start","queue_duration_s":1.060644,"scheduling_latency_s":1.06066}1490gitlab # [ 299.898594] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.926Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"367848482904cee283b3754d","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-367848482904cee283b3754d: done: 0.014882 sec","job_status":"done","queue_duration_s":1.060644,"scheduling_latency_s":1.06066,"redis_calls":13,"redis_duration_s":0.002667,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000926,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001741,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009259,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014882,"completed_at":"2026-08-29T13:44:05.926Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1491gitlab # [ 299.938657] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.927Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc4d422cbe16bd994a0c87dc","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc4d422cbe16bd994a0c87dc: start","job_status":"start","queue_duration_s":1.076956,"scheduling_latency_s":1.076973}1492gitlab # [ 299.951365] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.942Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc4d422cbe16bd994a0c87dc","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc4d422cbe16bd994a0c87dc: done: 0.014631 sec","job_status":"done","queue_duration_s":1.076956,"scheduling_latency_s":1.076973,"redis_calls":13,"redis_duration_s":0.002544,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000927,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001617,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009122,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014631,"completed_at":"2026-08-29T13:44:05.942Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1493gitlab # [ 299.992126] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.945Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7704f5559ddd1306e51fd2fa","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7704f5559ddd1306e51fd2fa: start","job_status":"start","queue_duration_s":1.094898,"scheduling_latency_s":1.094916}1494gitlab # [ 300.004604] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.960Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7704f5559ddd1306e51fd2fa","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7704f5559ddd1306e51fd2fa: done: 0.015069 sec","job_status":"done","queue_duration_s":1.094898,"scheduling_latency_s":1.094916,"redis_calls":13,"redis_duration_s":0.002709,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000934,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001775,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009272,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015069,"completed_at":"2026-08-29T13:44:05.960Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1495gitlab # [ 300.043756] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.962Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ed7c848c389124864468c22","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ed7c848c389124864468c22: start","job_status":"start","queue_duration_s":1.111422,"scheduling_latency_s":1.111439}1496gitlab # [ 300.056336] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.977Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ed7c848c389124864468c22","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ed7c848c389124864468c22: done: 0.015293 sec","job_status":"done","queue_duration_s":1.111422,"scheduling_latency_s":1.111439,"redis_calls":13,"redis_duration_s":0.002862,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000939,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001923,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00943,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015293,"completed_at":"2026-08-29T13:44:05.977Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1497gitlab # [ 300.095866] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.979Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8c34306e2d1a46ede6f84174","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8c34306e2d1a46ede6f84174: start","job_status":"start","queue_duration_s":1.128089,"scheduling_latency_s":1.128105}1498gitlab # [ 300.108697] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.994Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8c34306e2d1a46ede6f84174","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8c34306e2d1a46ede6f84174: done: 0.014991 sec","job_status":"done","queue_duration_s":1.128089,"scheduling_latency_s":1.128105,"redis_calls":13,"redis_duration_s":0.00267,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000934,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001736,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009403,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014991,"completed_at":"2026-08-29T13:44:05.993Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1499gitlab # [ 300.147715] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:05.995Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31ead9df10f2915ab55da1c5","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31ead9df10f2915ab55da1c5: start","job_status":"start","queue_duration_s":1.144419,"scheduling_latency_s":1.144434}1500gitlab # [ 300.160231] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.010Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31ead9df10f2915ab55da1c5","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31ead9df10f2915ab55da1c5: done: 0.015504 sec","job_status":"done","queue_duration_s":1.144419,"scheduling_latency_s":1.144434,"redis_calls":13,"redis_duration_s":0.003213,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001445,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001768,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00947,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015504,"completed_at":"2026-08-29T13:44:06.010Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1501gitlab # [ 300.200344] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.012Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c03ac75e6fb1bb35e50c07a8","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c03ac75e6fb1bb35e50c07a8: start","job_status":"start","queue_duration_s":1.1613,"scheduling_latency_s":1.161316}1502gitlab # [ 300.212344] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.027Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c03ac75e6fb1bb35e50c07a8","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c03ac75e6fb1bb35e50c07a8: done: 0.015429 sec","job_status":"done","queue_duration_s":1.1613,"scheduling_latency_s":1.161316,"redis_calls":13,"redis_duration_s":0.002934,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001013,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001921,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009632,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015429,"completed_at":"2026-08-29T13:44:06.027Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1503gitlab # [ 300.251162] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.028Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6dd40236baafb83979c0be02","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6dd40236baafb83979c0be02: start","job_status":"start","queue_duration_s":1.177912,"scheduling_latency_s":1.177927}1504gitlab # [ 300.263552] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.044Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6dd40236baafb83979c0be02","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6dd40236baafb83979c0be02: done: 0.015238 sec","job_status":"done","queue_duration_s":1.177912,"scheduling_latency_s":1.177927,"redis_calls":13,"redis_duration_s":0.00297,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000955,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002015,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009497,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015238,"completed_at":"2026-08-29T13:44:06.044Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1505gitlab # [ 300.302625] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.045Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"95bf447448b816e666ad859f","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-95bf447448b816e666ad859f: start","job_status":"start","queue_duration_s":1.194585,"scheduling_latency_s":1.194601}1506gitlab # [ 300.314884] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.060Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"95bf447448b816e666ad859f","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-95bf447448b816e666ad859f: done: 0.014768 sec","job_status":"done","queue_duration_s":1.194585,"scheduling_latency_s":1.194601,"redis_calls":13,"redis_duration_s":0.002709,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000919,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00179,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009152,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014768,"completed_at":"2026-08-29T13:44:06.060Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1507gitlab # [ 300.354177] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.061Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6460a68b128912c80b9c7b67","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6460a68b128912c80b9c7b67: start","job_status":"start","queue_duration_s":1.210642,"scheduling_latency_s":1.210669}1508gitlab # [ 300.367663] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.076Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6460a68b128912c80b9c7b67","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6460a68b128912c80b9c7b67: done: 0.014789 sec","job_status":"done","queue_duration_s":1.210642,"scheduling_latency_s":1.210669,"redis_calls":13,"redis_duration_s":0.0026680000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00091,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001758,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00923,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014789,"completed_at":"2026-08-29T13:44:06.076Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1509gitlab # [ 300.407207] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.077Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52c64e29fda69e2447c1ce39","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52c64e29fda69e2447c1ce39: start","job_status":"start","queue_duration_s":1.226974,"scheduling_latency_s":1.22699}1510gitlab # [ 300.419679] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.092Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52c64e29fda69e2447c1ce39","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52c64e29fda69e2447c1ce39: done: 0.014945 sec","job_status":"done","queue_duration_s":1.226974,"scheduling_latency_s":1.22699,"redis_calls":13,"redis_duration_s":0.002716,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000947,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001769,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009352,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014945,"completed_at":"2026-08-29T13:44:06.092Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1511gitlab # [ 300.459452] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.094Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"314d8091341c0609bfe499c1","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-314d8091341c0609bfe499c1: start","job_status":"start","queue_duration_s":1.243303,"scheduling_latency_s":1.243319}1512gitlab # [ 300.472210] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.109Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"314d8091341c0609bfe499c1","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-314d8091341c0609bfe499c1: done: 0.015602 sec","job_status":"done","queue_duration_s":1.243303,"scheduling_latency_s":1.243319,"redis_calls":13,"redis_duration_s":0.003227,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001372,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001855,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009495,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015602,"completed_at":"2026-08-29T13:44:06.109Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1513gitlab # [ 300.511565] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.111Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9c23ff774d8a60ffd2e5c72a","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9c23ff774d8a60ffd2e5c72a: start","job_status":"start","queue_duration_s":1.260408,"scheduling_latency_s":1.260425}1514gitlab # [ 300.524525] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.126Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9c23ff774d8a60ffd2e5c72a","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9c23ff774d8a60ffd2e5c72a: done: 0.015095 sec","job_status":"done","queue_duration_s":1.260408,"scheduling_latency_s":1.260425,"redis_calls":13,"redis_duration_s":0.002809,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00097,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001839,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00933,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015095,"completed_at":"2026-08-29T13:44:06.126Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1515gitlab # [ 300.563673] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.127Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"413fa3768638e53f07966899","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-413fa3768638e53f07966899: start","job_status":"start","queue_duration_s":1.276876,"scheduling_latency_s":1.276891}1516gitlab # [ 300.577609] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.142Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"413fa3768638e53f07966899","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-413fa3768638e53f07966899: done: 0.014702 sec","job_status":"done","queue_duration_s":1.276876,"scheduling_latency_s":1.276891,"redis_calls":13,"redis_duration_s":0.002603,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000924,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001679,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009201,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014702,"completed_at":"2026-08-29T13:44:06.142Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1517gitlab # [ 300.616516] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.143Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"96bf7b2a0335983c371fd98b","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-96bf7b2a0335983c371fd98b: start","job_status":"start","queue_duration_s":1.292951,"scheduling_latency_s":1.292967}1518gitlab # [ 300.628877] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.158Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"96bf7b2a0335983c371fd98b","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-96bf7b2a0335983c371fd98b: done: 0.014712 sec","job_status":"done","queue_duration_s":1.292951,"scheduling_latency_s":1.292967,"redis_calls":13,"redis_duration_s":0.002601,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001004,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001597,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009198,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014712,"completed_at":"2026-08-29T13:44:06.158Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1519gitlab # [ 300.667972] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.159Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b916482040e2c3bcce244918","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b916482040e2c3bcce244918: start","job_status":"start","queue_duration_s":1.309014,"scheduling_latency_s":1.30903}1520gitlab # [ 300.680518] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.174Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b916482040e2c3bcce244918","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b916482040e2c3bcce244918: done: 0.014961 sec","job_status":"done","queue_duration_s":1.309014,"scheduling_latency_s":1.30903,"redis_calls":13,"redis_duration_s":0.002814,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000966,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001848,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009356,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014961,"completed_at":"2026-08-29T13:44:06.174Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1521gitlab # [ 300.719543] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.176Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0202e099725b32da3e66a89","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0202e099725b32da3e66a89: start","job_status":"start","queue_duration_s":1.325358,"scheduling_latency_s":1.325373}1522gitlab # [ 300.732140] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.191Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0202e099725b32da3e66a89","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0202e099725b32da3e66a89: done: 0.014847 sec","job_status":"done","queue_duration_s":1.325358,"scheduling_latency_s":1.325373,"redis_calls":13,"redis_duration_s":0.002775,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000906,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001869,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009223,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014847,"completed_at":"2026-08-29T13:44:06.191Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1523gitlab # [ 300.770962] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.192Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9fb8fadd1fbba94ba2159f78","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9fb8fadd1fbba94ba2159f78: start","job_status":"start","queue_duration_s":1.341558,"scheduling_latency_s":1.341573}1524gitlab # [ 300.784410] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.207Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9fb8fadd1fbba94ba2159f78","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9fb8fadd1fbba94ba2159f78: done: 0.015036 sec","job_status":"done","queue_duration_s":1.341558,"scheduling_latency_s":1.341573,"redis_calls":13,"redis_duration_s":0.002713,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000982,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001731,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009484,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015036,"completed_at":"2026-08-29T13:44:06.207Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1525gitlab # [ 300.823212] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.209Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f6c639f60f584cf5729af0eb","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f6c639f60f584cf5729af0eb: start","job_status":"start","queue_duration_s":1.358482,"scheduling_latency_s":1.358499}1526gitlab # [ 300.835827] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.224Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f6c639f60f584cf5729af0eb","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f6c639f60f584cf5729af0eb: done: 0.014918 sec","job_status":"done","queue_duration_s":1.358482,"scheduling_latency_s":1.358499,"redis_calls":13,"redis_duration_s":0.002751,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000946,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001805,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00926,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014918,"completed_at":"2026-08-29T13:44:06.224Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1527gitlab # [ 300.875214] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.225Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e6679e20c037b3ac7fee601","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e6679e20c037b3ac7fee601: start","job_status":"start","queue_duration_s":1.37477,"scheduling_latency_s":1.374787}1528gitlab # [ 300.887775] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.240Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e6679e20c037b3ac7fee601","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e6679e20c037b3ac7fee601: done: 0.014685 sec","job_status":"done","queue_duration_s":1.37477,"scheduling_latency_s":1.374787,"redis_calls":13,"redis_duration_s":0.002578,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000913,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001665,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009255,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014685,"completed_at":"2026-08-29T13:44:06.240Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1529gitlab # [ 300.926874] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.241Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c9b5a84e14d665d7383da605","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c9b5a84e14d665d7383da605: start","job_status":"start","queue_duration_s":1.390771,"scheduling_latency_s":1.390786}1530gitlab # [ 300.939449] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.256Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c9b5a84e14d665d7383da605","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c9b5a84e14d665d7383da605: done: 0.014752 sec","job_status":"done","queue_duration_s":1.390771,"scheduling_latency_s":1.390786,"redis_calls":13,"redis_duration_s":0.0027140000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00091,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001804,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009199,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014752,"completed_at":"2026-08-29T13:44:06.256Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1531gitlab # [ 300.979843] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.257Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f7dfa3b82f558b240a8b7154","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f7dfa3b82f558b240a8b7154: start","job_status":"start","queue_duration_s":1.406863,"scheduling_latency_s":1.406879}1532gitlab # [ 300.992310] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.281Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f7dfa3b82f558b240a8b7154","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f7dfa3b82f558b240a8b7154: done: 0.023709 sec","job_status":"done","queue_duration_s":1.406863,"scheduling_latency_s":1.406879,"redis_calls":13,"redis_duration_s":0.0037270000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001188,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002539,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01581,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023709,"completed_at":"2026-08-29T13:44:06.281Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1533gitlab # [ 301.031528] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.284Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b890203913a8a65315752dee","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b890203913a8a65315752dee: start","job_status":"start","queue_duration_s":1.433221,"scheduling_latency_s":1.43326}1534gitlab # [ 301.044073] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.313Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b890203913a8a65315752dee","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b890203913a8a65315752dee: done: 0.028997 sec","job_status":"done","queue_duration_s":1.433221,"scheduling_latency_s":1.43326,"redis_calls":13,"redis_duration_s":0.0029100000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000864,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002046,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019861,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028997,"completed_at":"2026-08-29T13:44:06.313Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1535gitlab # [ 301.082805] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.314Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d8cc1ed8490df319da35abe","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d8cc1ed8490df319da35abe: start","job_status":"start","queue_duration_s":1.463558,"scheduling_latency_s":1.463579}1536gitlab # [ 301.095055] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.332Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d8cc1ed8490df319da35abe","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d8cc1ed8490df319da35abe: done: 0.017545 sec","job_status":"done","queue_duration_s":1.463558,"scheduling_latency_s":1.463579,"redis_calls":13,"redis_duration_s":0.001774,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000622,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001152,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012037,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017545,"completed_at":"2026-08-29T13:44:06.331Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1537gitlab # [ 301.133832] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.333Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d81a1d3c79328a162bf80957","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d81a1d3c79328a162bf80957: start","job_status":"start","queue_duration_s":1.482356,"scheduling_latency_s":1.482376}1538gitlab # [ 301.146175] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.348Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d81a1d3c79328a162bf80957","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d81a1d3c79328a162bf80957: done: 0.015377 sec","job_status":"done","queue_duration_s":1.482356,"scheduling_latency_s":1.482376,"redis_calls":13,"redis_duration_s":0.001532,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000981,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010622,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015377,"completed_at":"2026-08-29T13:44:06.348Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1539gitlab # [ 301.185518] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.349Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d297ecb163e1d344506783b","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d297ecb163e1d344506783b: start","job_status":"start","queue_duration_s":1.498948,"scheduling_latency_s":1.498966}1540gitlab # [ 301.197787] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.364Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d297ecb163e1d344506783b","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d297ecb163e1d344506783b: done: 0.014797 sec","job_status":"done","queue_duration_s":1.498948,"scheduling_latency_s":1.498966,"redis_calls":13,"redis_duration_s":0.001543,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001018,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010137,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014797,"completed_at":"2026-08-29T13:44:06.364Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1541gitlab # [ 301.236757] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.366Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f7311f05445f9fdcae3600d6","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f7311f05445f9fdcae3600d6: start","job_status":"start","queue_duration_s":1.515036,"scheduling_latency_s":1.515055}1542gitlab # [ 301.248821] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.379Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f7311f05445f9fdcae3600d6","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f7311f05445f9fdcae3600d6: done: 0.013907 sec","job_status":"done","queue_duration_s":1.515036,"scheduling_latency_s":1.515055,"redis_calls":13,"redis_duration_s":0.001419,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000899,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009601,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013907,"completed_at":"2026-08-29T13:44:06.379Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1543gitlab # [ 301.287724] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.380Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b1a02ac347d2042b19ac1350","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b1a02ac347d2042b19ac1350: start","job_status":"start","queue_duration_s":1.529984,"scheduling_latency_s":1.53}1544gitlab # [ 301.300422] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.394Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b1a02ac347d2042b19ac1350","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b1a02ac347d2042b19ac1350: done: 0.013967 sec","job_status":"done","queue_duration_s":1.529984,"scheduling_latency_s":1.53,"redis_calls":13,"redis_duration_s":0.0013930000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000885,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009644,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013967,"completed_at":"2026-08-29T13:44:06.394Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1545gitlab # [ 301.339179] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.396Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"781201a9894e11e70ebdddb5","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-781201a9894e11e70ebdddb5: start","job_status":"start","queue_duration_s":1.54504,"scheduling_latency_s":1.545057}1546gitlab # [ 301.351429] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.410Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"781201a9894e11e70ebdddb5","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-781201a9894e11e70ebdddb5: done: 0.014391 sec","job_status":"done","queue_duration_s":1.54504,"scheduling_latency_s":1.545057,"redis_calls":13,"redis_duration_s":0.001435,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000891,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009681,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014391,"completed_at":"2026-08-29T13:44:06.410Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1547gitlab # [ 301.391191] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.411Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"346ca2fa215eb9fe02a0af13","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-346ca2fa215eb9fe02a0af13: start","job_status":"start","queue_duration_s":1.560562,"scheduling_latency_s":1.560579}1548gitlab # [ 301.403574] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.425Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"346ca2fa215eb9fe02a0af13","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-346ca2fa215eb9fe02a0af13: done: 0.014438 sec","job_status":"done","queue_duration_s":1.560562,"scheduling_latency_s":1.560579,"redis_calls":13,"redis_duration_s":0.001426,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000882,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009803,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014438,"completed_at":"2026-08-29T13:44:06.425Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1549gitlab # [ 301.442805] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.427Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f3459f014e235162bc1b62ad","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f3459f014e235162bc1b62ad: start","job_status":"start","queue_duration_s":1.576087,"scheduling_latency_s":1.576104}1550gitlab # [ 301.455483] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.441Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f3459f014e235162bc1b62ad","created_at":"2026-08-29T13:44:04.775Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-1da481e861e94dac","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b47b4641524b9e1dc318d132c6dbee20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:04.850Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f3459f014e235162bc1b62ad: done: 0.014034 sec","job_status":"done","queue_duration_s":1.576087,"scheduling_latency_s":1.576104,"redis_calls":13,"redis_duration_s":0.001401,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00089,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009743,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014034,"completed_at":"2026-08-29T13:44:06.441Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1551gitlab # [ 301.494311] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.442Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"b7ec8a69e086322fffd4f3e6","created_at":"2026-08-29T13:44:04.956Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-27a7dce5550144c3","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"c2bc2d06eef43e05010182d094288a28","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:05.010Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-b7ec8a69e086322fffd4f3e6: start","job_status":"start","queue_duration_s":1.431985,"scheduling_latency_s":1.432002}1552gitlab # [ 301.507390] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.492Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"b7ec8a69e086322fffd4f3e6","created_at":"2026-08-29T13:44:04.956Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-27a7dce5550144c3","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"c2bc2d06eef43e05010182d094288a28","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:05.010Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-b7ec8a69e086322fffd4f3e6: done: 0.050142 sec","job_status":"done","queue_duration_s":1.431985,"scheduling_latency_s":1.432002,"redis_calls":16,"redis_duration_s":0.002048,"redis_read_bytes":14,"redis_write_bytes":1526,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000331,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000596,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":423,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001121,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":802,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022899,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025338,"duration_s":0.050142,"completed_at":"2026-08-29T13:44:06.492Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.021342,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1553gitlab # [ 301.548358] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.493Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"d5c7c401c98653683c9167cb","created_at":"2026-08-29T13:44:04.956Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-27a7dce5550144c3","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"c2bc2d06eef43e05010182d094288a28","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:05.010Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-d5c7c401c98653683c9167cb: start","job_status":"start","queue_duration_s":1.483304,"scheduling_latency_s":1.483322}1554gitlab # [ 301.561545] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.510Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"d5c7c401c98653683c9167cb","created_at":"2026-08-29T13:44:04.956Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-27a7dce5550144c3","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"c2bc2d06eef43e05010182d094288a28","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:05.010Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-d5c7c401c98653683c9167cb: done: 0.017319 sec","job_status":"done","queue_duration_s":1.483304,"scheduling_latency_s":1.483322,"redis_calls":13,"redis_duration_s":0.001641,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001086,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010711,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017319,"completed_at":"2026-08-29T13:44:06.510Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001917,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1555gitlab # [ 301.601708] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.512Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"026cd53a2ed01caf10f3942b","created_at":"2026-08-29T13:44:04.956Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-27a7dce5550144c3","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"c2bc2d06eef43e05010182d094288a28","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:05.010Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-026cd53a2ed01caf10f3942b: start","job_status":"start","queue_duration_s":1.501826,"scheduling_latency_s":1.501843}1556gitlab # [ 301.614928] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.528Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"026cd53a2ed01caf10f3942b","created_at":"2026-08-29T13:44:04.956Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-27a7dce5550144c3","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"c2bc2d06eef43e05010182d094288a28","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:05.010Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-026cd53a2ed01caf10f3942b: done: 0.01654 sec","job_status":"done","queue_duration_s":1.501826,"scheduling_latency_s":1.501843,"redis_calls":13,"redis_duration_s":0.001505,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000545,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00096,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010323,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01654,"completed_at":"2026-08-29T13:44:06.528Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001783,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1557gitlab # [ 301.654103] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.531Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"f4d01d16dcf2b131b726911e","created_at":"2026-08-29T13:44:04.956Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-27a7dce5550144c3","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"c2bc2d06eef43e05010182d094288a28","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:05.010Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-f4d01d16dcf2b131b726911e: start","job_status":"start","queue_duration_s":1.521004,"scheduling_latency_s":1.521047}1558gitlab # [ 301.667506] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.569Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"f4d01d16dcf2b131b726911e","created_at":"2026-08-29T13:44:04.956Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-27a7dce5550144c3","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"c2bc2d06eef43e05010182d094288a28","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:05.010Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-f4d01d16dcf2b131b726911e: done: 0.038739 sec","job_status":"done","queue_duration_s":1.521004,"scheduling_latency_s":1.521047,"redis_calls":13,"redis_duration_s":0.0036499999999999996,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001207,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002443,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026232,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038739,"completed_at":"2026-08-29T13:44:06.569Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001571,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1559gitlab # [ 301.707132] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.573Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"5bf519aaedcb54ac7b3f8477","created_at":"2026-08-29T13:44:04.956Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-27a7dce5550144c3","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"c2bc2d06eef43e05010182d094288a28","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:05.010Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-5bf519aaedcb54ac7b3f8477: start","job_status":"start","queue_duration_s":1.562732,"scheduling_latency_s":1.562773}1560gitlab # [ 301.720400] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.610Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"5bf519aaedcb54ac7b3f8477","created_at":"2026-08-29T13:44:04.956Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-27a7dce5550144c3","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"c2bc2d06eef43e05010182d094288a28","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:05.010Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-5bf519aaedcb54ac7b3f8477: done: 0.03795 sec","job_status":"done","queue_duration_s":1.562732,"scheduling_latency_s":1.562773,"redis_calls":13,"redis_duration_s":0.004455000000000001,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001565,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00289,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024974,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03795,"completed_at":"2026-08-29T13:44:06.610Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001958,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1561gitlab # [ 301.759802] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.613Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"3fbdf4a0878617498e7ae1c9","created_at":"2026-08-29T13:44:04.956Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-27a7dce5550144c3","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"c2bc2d06eef43e05010182d094288a28","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:05.010Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-3fbdf4a0878617498e7ae1c9: start","job_status":"start","queue_duration_s":1.603149,"scheduling_latency_s":1.603181}1562gitlab # [ 301.773006] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.643Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"3fbdf4a0878617498e7ae1c9","created_at":"2026-08-29T13:44:04.956Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-27a7dce5550144c3","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"c2bc2d06eef43e05010182d094288a28","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:05.010Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-3fbdf4a0878617498e7ae1c9: done: 0.029709 sec","job_status":"done","queue_duration_s":1.603149,"scheduling_latency_s":1.603181,"redis_calls":13,"redis_duration_s":0.003961,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001256,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002705,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018329,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029709,"completed_at":"2026-08-29T13:44:06.642Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001933,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1563gitlab # [ 301.813683] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.645Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"bd8220538c3cdaa45f2df4db","created_at":"2026-08-29T13:44:04.956Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-27a7dce5550144c3","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"c2bc2d06eef43e05010182d094288a28","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:05.010Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-bd8220538c3cdaa45f2df4db: start","job_status":"start","queue_duration_s":1.634947,"scheduling_latency_s":1.634975}1564gitlab # [ 301.827418] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.671Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"bd8220538c3cdaa45f2df4db","created_at":"2026-08-29T13:44:04.956Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-27a7dce5550144c3","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"c2bc2d06eef43e05010182d094288a28","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:05.010Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-bd8220538c3cdaa45f2df4db: done: 0.026203 sec","job_status":"done","queue_duration_s":1.634947,"scheduling_latency_s":1.634975,"redis_calls":13,"redis_duration_s":0.003863,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001181,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002682,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016578,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026203,"completed_at":"2026-08-29T13:44:06.671Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001242,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1565gitlab # [ 301.866628] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.673Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"95858d104cab011c37a4ea2f","created_at":"2026-08-29T13:44:04.956Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-27a7dce5550144c3","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"c2bc2d06eef43e05010182d094288a28","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:05.010Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-95858d104cab011c37a4ea2f: start","job_status":"start","queue_duration_s":1.663621,"scheduling_latency_s":1.663653}1566gitlab # [ 301.879651] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.697Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"95858d104cab011c37a4ea2f","created_at":"2026-08-29T13:44:04.956Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-27a7dce5550144c3","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"c2bc2d06eef43e05010182d094288a28","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:05.010Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-95858d104cab011c37a4ea2f: done: 0.023541 sec","job_status":"done","queue_duration_s":1.663621,"scheduling_latency_s":1.663653,"redis_calls":13,"redis_duration_s":0.003405,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001116,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002289,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014478,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023541,"completed_at":"2026-08-29T13:44:06.697Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00122,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1567gitlab # [ 301.919955] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.699Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"935cc31888c0934ae7bdfda2","created_at":"2026-08-29T13:44:04.956Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-27a7dce5550144c3","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"c2bc2d06eef43e05010182d094288a28","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:05.010Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-935cc31888c0934ae7bdfda2: start","job_status":"start","queue_duration_s":1.688933,"scheduling_latency_s":1.688954}1568gitlab # [ 301.933219] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.725Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"935cc31888c0934ae7bdfda2","created_at":"2026-08-29T13:44:04.956Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-27a7dce5550144c3","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"c2bc2d06eef43e05010182d094288a28","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:05.010Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-935cc31888c0934ae7bdfda2: done: 0.026135 sec","job_status":"done","queue_duration_s":1.688933,"scheduling_latency_s":1.688954,"redis_calls":13,"redis_duration_s":0.004076,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00093,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003146,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013645,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026135,"completed_at":"2026-08-29T13:44:06.725Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00453,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1569gitlab # [ 301.972976] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.727Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"4957066f93e2b712c2f66369","created_at":"2026-08-29T13:44:04.956Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-27a7dce5550144c3","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"c2bc2d06eef43e05010182d094288a28","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:05.010Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-4957066f93e2b712c2f66369: start","job_status":"start","queue_duration_s":1.717504,"scheduling_latency_s":1.717525}1570gitlab # [ 301.986269] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:06.756Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"4957066f93e2b712c2f66369","created_at":"2026-08-29T13:44:04.956Z","trace_propagation_headers":{"sentry-trace":"f1e4d9e8f14d46bbb28b7e4ff1891387-27a7dce5550144c3","baggage":"sentry-trace_id=f1e4d9e8f14d46bbb28b7e4ff1891387,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"c2bc2d06eef43e05010182d094288a28","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:05.010Z","job_size_bytes":2,"pid":2047,"sidekiq_tid":"maon","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-4957066f93e2b712c2f66369: done: 0.029117 sec","job_status":"done","queue_duration_s":1.717504,"scheduling_latency_s":1.717525,"redis_calls":13,"redis_duration_s":0.0043690000000000005,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00127,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003099,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018265,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029117,"completed_at":"2026-08-29T13:44:06.756Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00127,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1571gitlab # [ 308.266550] redis[789]: 10 changes in 300 seconds. Saving...1572gitlab # [ 308.273002] redis[789]: Background saving started by pid 33071573gitlab # [ 308.280874] redis[3307]: BGSAVE done, 462 keys saved, 0 keys skipped, 119184 bytes written.1574gitlab # [ 308.286011] redis[3307]: DB saved on disk1575gitlab # [ 308.288250] redis[3307]: Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB1576gitlab # [ 308.367634] redis[789]: Background saving terminated with success1577gitlab # [ 309.487531] postgres[864]: [864] LOG: checkpoint starting: time1578gitlab # [ 311.038334] gitaly[896]: time="2026-08-29T13:44:17.841Z" level=info msg="burden monitor stats" pid=8961579gitlab # [ 316.818205] postgres[3325]: [3325] ERROR: relation "table_without_models" does not exist1580gitlab # [ 316.818509] postgres[3325]: [3325] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1581gitlab # [ 322.540446] runuser[2986]: pam_unix(runuser:session): session closed for user gitlab1582gitlab # [ 322.542072] setup-gitlab-start[2959]: + systemctl restart gitlab-sidekiq.service1583gitlab # [ 322.580989] systemd[1]: Stopping gitlab-sidekiq.service...1584gitlab # [ 322.584431] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:29.385Z","message":"Shutting down"}1585gitlab # [ 322.588533] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:29.385Z","message":"Scheduler exiting..."}1586gitlab # [ 322.592796] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:29.385Z","message":"Terminating quiet threads for default capsule"}1587gitlab # [ 322.597844] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:29.385Z","message":"Scheduler exiting..."}1588gitlab # [ 323.082127] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:29.886Z","message":"Pausing to allow jobs to finish..."}1589gitlab # [ 325.586406] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:32.389Z","message":"Bye!"}1590gitlab # [ 325.626518] sidekiq-cluster[2047]: {"severity":"INFO","time":"2026-08-29T13:44:32.431Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":2047,"worker_id":"sidekiq_0","memwd_rss_bytes":957468672,"retry":0}1591gitlab # [ 326.922471] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1592gitlab # [ 326.922875] systemd[1]: Stopped gitlab-sidekiq.service.1593gitlab # [ 326.923085] systemd[1]: gitlab-sidekiq.service: Consumed 1min 51.642s CPU time over 3min 22.276s wall clock time, 948.1M memory peak, 4.5M read from disk.1594gitlab # [ 326.936564] systemd[1]: Started gitlab-sidekiq.service.1595gitlab # [ 326.942549] setup-gitlab-start[2959]: + mkdir -p /var/lib/secrets1596gitlab # [ 326.949390] setup-gitlab-start[2959]: + echo nixbot-test-token-of-20-chars1597gitlab # [ 326.952567] setup-gitlab-start[2959]: + chmod 644 /var/lib/secrets/gitlab-token1598gitlab # [ 326.955517] setup-gitlab-start[2959]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1599gitlab # [ 328.852752] gitaly[896]: time="2026-08-29T13:44:35.656Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M16W7M7WHJYQ9W77ZVD7EYAR error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-29T13:44:45.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-29T13:44:35.655" pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1600gitlab # [ 328.853223] gitaly[896]: time="2026-08-29T13:44:35.657Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M16W7M7WHJYQ9W77ZVD7EYAR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-29T13:44:45.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-29T13:44:35.655" grpc.time_ms=1.025 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1601gitlab # [ 329.029211] gitaly[896]: time="2026-08-29T13:44:35.833Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M16W7M7WHJYQ9W77ZVD7EYAR error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-29T13:44:45.182" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-29T13:44:35.833" pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1602gitlab # [ 329.060735] gitaly[896]: time="2026-08-29T13:44:35.834Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M16W7M7WHJYQ9W77ZVD7EYAR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-29T13:44:45.182" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-29T13:44:35.833" grpc.time_ms=0.653 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1603gitlab # [ 329.106602] gitaly[896]: time="2026-08-29T13:44:35.911Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M16W7M7WHJYQ9W77ZVD7EYAR diskcache=6d0f417b-4246-42ff-ad84-ff6b9fff0479 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-29T13:44:45.193" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-29T13:44:35.844" pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1604gitlab # [ 329.135716] gitaly[896]: time="2026-08-29T13:44:35.911Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=38 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1438 command.oublock=32 command.real_time_ms=42 command.spawn_token_fork_ms=3 command.system_time_ms=35 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M16W7M7WHJYQ9W77ZVD7EYAR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-29T13:44:45.193" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-29T13:44:35.844" grpc.time_ms=67.271 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1605gitlab # [ 329.161369] gitaly[896]: time="2026-08-29T13:44:35.937Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M16W7M7WHJYQ9W77ZVD7EYAR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-29T13:44:45.285" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-29T13:44:35.935" pid=896 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1606gitlab # [ 329.178969] gitaly[896]: time="2026-08-29T13:44:35.937Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M16W7M7WHJYQ9W77ZVD7EYAR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-29T13:44:45.285" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-29T13:44:35.935" grpc.time_ms=1.55 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1607gitlab # [ 329.196156] gitaly[896]: time="2026-08-29T13:44:35.962Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M16W7M7WHJYQ9W77ZVD7EYAR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-29T13:44:45.004" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-29T13:44:35.945" grpc.time_ms=16.749 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1608gitlab # [ 329.273037] gitaly[896]: time="2026-08-29T13:44:36.077Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M16W7M7WHJYQ9W77ZVD7EYAR error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-29T13:44:46.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-29T13:44:36.077" pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1609gitlab # [ 329.291209] gitaly[896]: time="2026-08-29T13:44:36.078Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M16W7M7WHJYQ9W77ZVD7EYAR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-29T13:44:46.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-29T13:44:36.077" grpc.time_ms=0.597 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1610gitlab # [ 329.320934] gitaly[896]: time="2026-08-29T13:44:36.125Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M16W7M7WHJYQ9W77ZVD7EYAR diskcache=239b393d-4914-4d83-9981-7a05ea745c69 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-29T13:44:46.011" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-29T13:44:36.082" pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1611gitlab # [ 329.336832] gitaly[896]: time="2026-08-29T13:44:36.126Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=17 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1439 command.oublock=32 command.real_time_ms=21 command.spawn_token_fork_ms=3 command.system_time_ms=14 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M16W7M7WHJYQ9W77ZVD7EYAR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-29T13:44:46.011" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-29T13:44:36.082" grpc.time_ms=43.753 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1612gitlab # [ 329.354596] gitaly[896]: time="2026-08-29T13:44:36.140Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M16W7M7WHJYQ9W77ZVD7EYAR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-29T13:44:46.068" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-29T13:44:36.139" pid=896 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1613gitlab # [ 329.367511] gitaly[896]: time="2026-08-29T13:44:36.140Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M16W7M7WHJYQ9W77ZVD7EYAR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-29T13:44:46.068" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-29T13:44:36.139" grpc.time_ms=1.305 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1614gitlab # [ 329.379066] gitaly[896]: time="2026-08-29T13:44:36.163Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M16W7M7WHJYQ9W77ZVD7EYAR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-29T13:44:46.077" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-29T13:44:36.147" grpc.time_ms=15.915 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1615gitlab # [ 329.431182] gitaly[896]: time="2026-08-29T13:44:36.236Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M16W7M7WHJYQ9W77ZVD7EYAR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-29T13:44:46.165" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-29T13:44:36.235" grpc.time_ms=0.282 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1616gitlab # [ 329.447583] gitaly[896]: time="2026-08-29T13:44:36.252Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M16W7M7WHJYQ9W77ZVD7EYAR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-29T13:44:46.180" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-29T13:44:36.251" grpc.time_ms=0.84 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1617gitlab # [ 330.161218] gitaly[896]: time="2026-08-29T13:44:36.964Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M16W7M7WHJYQ9W77ZVD7EYAR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-29T13:44:46.007" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-29T13:44:36.947" grpc.time_ms=17.05 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1618gitlab # [ 330.565338] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:44:37 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 35801619gitlab # [ 330.571979] setup-gitlab-start[2959]: + mkdir -p /tmp/test-flake1620gitlab # [ 330.574731] setup-gitlab-start[2959]: + cd /tmp/test-flake1621gitlab # [ 330.577490] setup-gitlab-start[2959]: + git init -b master1622gitlab # [ 330.602166] setup-gitlab-start[3443]: Initialized empty Git repository in /tmp/test-flake/.git/1623gitlab # [ 330.605889] setup-gitlab-start[2959]: + git config user.name test1624gitlab # [ 330.609510] setup-gitlab-start[2959]: + git config user.email test@example.com1625gitlab # [ 330.616628] setup-gitlab-start[2959]: + cat1626gitlab # [ 330.622046] setup-gitlab-start[2959]: + git add flake.nix1627gitlab # [ 330.630230] setup-gitlab-start[2959]: + git commit -m 'initial commit'1628gitlab # [ 330.657400] setup-gitlab-start[3448]: [master (root-commit) 00271b6] initial commit1629gitlab # [ 330.660802] setup-gitlab-start[3448]: 1 file changed, 10 insertions(+)1630gitlab # [ 330.663227] setup-gitlab-start[3448]: create mode 100644 flake.nix1631gitlab # [ 330.665694] setup-gitlab-start[2959]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1632gitlab # [ 330.672543] setup-gitlab-start[2959]: + git push -u origin master1633gitlab # [ 330.803355] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:44:37 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 871634gitlab # [ 330.999058] gitaly[896]: time="2026-08-29T13:44:37.803Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M16W7QZ9Z33K8B3SQ2AQ0VEK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-29T13:44:37.785" grpc.time_ms=18.18 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1635gitlab # [ 331.039963] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:44:37 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 1941636gitlab # [ 332.017418] gitaly[896]: time="2026-08-29T13:44:38.821Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M16W7R5X03E0YY4H97G573W6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-29T13:44:48.004" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-29T13:44:38.805" grpc.time_ms=15.862 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1637gitlab # [ 332.074086] gitaly[896]: time="2026-08-29T13:44:38.878Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=300 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M16W7R5X03E0YY4H97G573W6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-29T13:45:08.066" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-29T13:44:38.867" grpc.time_ms=11.358 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1638gitlab # [ 332.115589] sidekiq-cluster[3387]: {"severity":"INFO","time":"2026-08-29T13:44:38.883Z","message":"Starting cluster with 1 processes"}1639gitlab # [ 332.150771] gitaly[896]: time="2026-08-29T13:44:38.955Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M16W7R5X03E0YY4H97G573W6 duration_ms=354ns method=POST pid=896 status=200 url="http://unix/api/v4/internal/allowed"1640gitlab # [ 332.188452] gitaly[896]: time="2026-08-29T13:44:38.993Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M16W7R5X03E0YY4H97G573W6 duration_ms=37ns method=POST pid=896 status=200 url="http://unix/api/v4/internal/pre_receive"1641gitlab # [ 332.200325] gitaly[896]: time="2026-08-29T13:44:38.993Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M16W7R5X03E0YY4H97G573W6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-29T13:44:38.598" grpc.time_ms=395.06 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1642gitlab # [ 332.251980] gitaly[896]: time="2026-08-29T13:44:39.056Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M16W7R5X03E0YY4H97G573W6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-29T13:44:39.055" grpc.time_ms=1.523 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1643gitlab # [ 332.327981] gitaly[896]: time="2026-08-29T13:44:39.132Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M16W7R5X03E0YY4H97G573W6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-29T13:44:39.131" grpc.time_ms=0.932 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1644gitlab # [ 332.400683] gitaly[896]: time="2026-08-29T13:44:39.205Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M16W7R5X03E0YY4H97G573W6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-29T13:44:39.204" grpc.time_ms=0.74 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1645gitlab # [ 332.571019] gitaly[896]: time="2026-08-29T13:44:39.375Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M16W7R5X03E0YY4H97G573W6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-29T13:44:49.290" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-29T13:44:39.360" grpc.time_ms=14.753 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1646gitlab # [ 332.617431] gitaly[896]: time="2026-08-29T13:44:39.422Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1434 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M16W7R5X03E0YY4H97G573W6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-29T13:44:49.004" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-29T13:44:39.395" grpc.time_ms=26.721 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1647gitlab # [ 332.663846] gitaly[896]: time="2026-08-29T13:44:39.446Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M16W7R5X03E0YY4H97G573W6 duration_ms=193ns method=POST pid=896 status=200 url="http://unix/api/v4/internal/post_receive"1648gitlab # [ 332.672295] gitaly[896]: time="2026-08-29T13:44:39.447Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M16W7R5X03E0YY4H97G573W6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-29T13:44:39.252" grpc.time_ms=194.955 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1649gitlab # [ 332.697945] gitaly[896]: time="2026-08-29T13:44:39.474Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M16W7R5X03E0YY4H97G573W6 diskcache=b6da0fc2-757b-45d9-a3b5-aedd6a8ce376 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-29T13:44:38.476" pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1650gitlab # [ 332.717604] systemd[1]: Finished setup-gitlab.service.1651gitlab # [ 332.719299] gitlab-workhorse[822]: time="2026-08-29T13:44:39Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521652gitlab # [ 332.722336] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:44:39 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 16541653gitlab # [ 332.725468] setup-gitlab-start[3452]: To http://gitlab/root/test-flake.git1654gitlab # [ 332.726800] setup-gitlab-start[3452]: * [new branch] master -> master1655gitlab # [ 332.728144] setup-gitlab-start[3452]: branch 'master' set up to track 'origin/master'.1656gitlab # [ 332.729608] gitaly[896]: time="2026-08-29T13:44:39.475Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=358 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=851968 command.minflt=13477 command.oublock=32 command.real_time_ms=991 command.spawn_token_fork_ms=1 command.system_time_ms=209 command.user_time_ms=149 component=gitaly.StreamServerInterceptor correlation_id=01M16W7R5X03E0YY4H97G573W6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=684 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-29T13:44:38.476" grpc.time_ms=998.374 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1657gitlab # [ 332.747293] systemd[1]: Starting nixbot CI service...1658gitlab: (finished: waiting for unit setup-gitlab.service, in 334.06 seconds)1659gitlab: waiting for unit nixbot.service1660gitlab # [ 334.033703] nixbot[3547]: {"ts": "2026-08-29T13:44:40.837Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1661gitlab # [ 334.056832] nixbot[3547]: {"ts": "2026-08-29T13:44:40.861Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1662gitlab # [ 334.100452] nixbot[3547]: {"ts": "2026-08-29T13:44:40.905Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1663gitlab # [ 334.109240] nixbot[3547]: {"ts": "2026-08-29T13:44:40.913Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1664gitlab # [ 334.116282] nixbot[3547]: {"ts": "2026-08-29T13:44:40.920Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1665gitlab # [ 334.127566] nixbot[3547]: {"ts": "2026-08-29T13:44:40.932Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1666gitlab # [ 334.134820] nixbot[3547]: {"ts": "2026-08-29T13:44:40.939Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1667gitlab # [ 334.139156] nixbot[3547]: {"ts": "2026-08-29T13:44:40.942Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1668gitlab # [ 334.149285] nixbot[3547]: {"ts": "2026-08-29T13:44:40.953Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1669gitlab # [ 334.153929] nixbot[3547]: {"ts": "2026-08-29T13:44:40.956Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1670gitlab # [ 334.161497] nixbot[3547]: {"ts": "2026-08-29T13:44:40.966Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1671gitlab # [ 334.172083] nixbot[3547]: {"ts": "2026-08-29T13:44:40.976Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1672gitlab # [ 334.177140] nixbot[3547]: {"ts": "2026-08-29T13:44:40.981Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1673gitlab # [ 334.181944] nixbot[3547]: {"ts": "2026-08-29T13:44:40.984Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1674gitlab # [ 334.186820] nixbot[3547]: {"ts": "2026-08-29T13:44:40.990Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1675gitlab # [ 334.191668] nixbot[3547]: {"ts": "2026-08-29T13:44:40.992Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1676gitlab # [ 334.196075] nixbot[3547]: {"ts": "2026-08-29T13:44:40.994Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1677gitlab # [ 334.200211] nixbot[3547]: {"ts": "2026-08-29T13:44:40.996Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1678gitlab # [ 334.204081] nixbot[3547]: {"ts": "2026-08-29T13:44:41.002Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1679gitlab # [ 334.207948] nixbot[3547]: {"ts": "2026-08-29T13:44:41.004Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1680gitlab # [ 334.212072] nixbot[3547]: {"ts": "2026-08-29T13:44:41.006Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1681gitlab # [ 334.215923] nixbot[3547]: {"ts": "2026-08-29T13:44:41.013Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1682gitlab # [ 334.220192] nixbot[3547]: {"ts": "2026-08-29T13:44:41.015Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1683gitlab # [ 334.224052] nixbot[3547]: {"ts": "2026-08-29T13:44:41.018Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1684gitlab # [ 334.227473] nixbot[3547]: {"ts": "2026-08-29T13:44:41.019Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1685gitlab # [ 334.231088] nixbot[3547]: {"ts": "2026-08-29T13:44:41.022Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"}1686gitlab # [ 334.234566] nixbot[3547]: {"ts": "2026-08-29T13:44:41.025Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"}1687gitlab # [ 334.716145] nixbot[3547]: INFO: Started server process [3547]1688gitlab # [ 334.718915] nixbot[3547]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1689gitlab # [ 334.736304] nixbot[3547]: INFO: ::ffff:127.0.0.1:60856 - "GET /health HTTP/1.1" 200 OK1690gitlab # [ 334.742547] systemd[1]: Started nixbot CI service.1691gitlab # [ 334.748076] systemd[1]: Reached target Multi-User System.1692gitlab # [ 334.751997] systemd[1]: Startup finished in 766ms (kernel) + 3.421s (initrd) + 5min 30.563s (userspace) = 5min 34.751s.1693gitlab: (finished: waiting for unit nixbot.service, in 2.14 seconds)1694gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1695gitlab # [ 335.809630] nixbot[3547]: INFO: ::ffff:127.0.0.1:60870 - "GET /health HTTP/1.1" 200 OK1696gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.06 seconds)1697subtest: project discovered and webhook registered1698gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1699gitlab # [ 335.991761] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:44:42 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 1221700gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.18 seconds)1701gitlab # [ 336.020761] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:44:42 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 12851702gitlab # [ 336.028061] nixbot[3547]: {"ts": "2026-08-29T13:44:42.826Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1703gitlab # [ 336.051807] nixbot[3547]: {"ts": "2026-08-29T13:44:42.856Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1704gitlab # [ 336.157318] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:44:42 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 951705gitlab # [ 336.163802] nixbot[3547]: {"ts": "2026-08-29T13:44:42.964Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1706gitlab # [ 336.170924] nixbot[3547]: {"ts": "2026-08-29T13:44:42.967Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1707gitlab # [ 336.379068] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:44:43 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 2101708gitlab # [ 336.385758] nixbot[3547]: {"ts": "2026-08-29T13:44:43.184Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1709gitlab # [ 336.561848] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:44:43 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 1701710gitlab # [ 336.569472] nixbot[3547]: {"ts": "2026-08-29T13:44:43.366Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1711gitlab # [ 336.672131] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:44:43 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 1011712gitlab # [ 336.678901] nixbot[3547]: {"ts": "2026-08-29T13:44:43.478Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1713gitlab # [ 336.749657] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:44:43 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 671714gitlab # [ 336.756293] nixbot[3547]: {"ts": "2026-08-29T13:44:43.555Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1715gitlab # [ 336.831455] gitaly[896]: time="2026-08-29T13:44:43.635Z" level=info msg="finished unary call with code OK" catfile.duration_ms=6 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=6 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M16W7XS8Y9HRAK7J3ZJ1NQ6E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-08-29T13:45:13.011" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-08-29T13:44:43.612" grpc.time_ms=22.039 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1716gitlab # [ 336.875679] gitaly[896]: time="2026-08-29T13:44:43.651Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M16W7XS8Y9HRAK7J3ZJ1NQ6E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-29T13:45:13.050" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:44:43.650" grpc.time_ms=1.262 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1717gitlab # [ 336.900835] gitaly[896]: time="2026-08-29T13:44:43.663Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M16W7XS8Y9HRAK7J3ZJ1NQ6E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-29T13:44:53.004" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:44:43.654" grpc.time_ms=8.084 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1718gitlab # [ 336.921092] nixbot[3547]: {"ts": "2026-08-29T13:44:43.697Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1719gitlab # [ 336.924288] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:44:43 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 1351720gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1721gitlab # [ 337.188741] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:44:43 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 2911722gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.21 seconds)1723gitlab # [ 337.198858] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:44:43 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 1381724(finished: subtest: project discovered and webhook registered, in 1.39 seconds)1725subtest: push delivers the webhook1726gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1727gitlab # [ 337.204989] nixbot[3547]: {"ts": "2026-08-29T13:44:43.995Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1728gitlab # [ 337.218377] nixbot[3547]: {"ts": "2026-08-29T13:44:44.003Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1729gitlab # [ 337.300115] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:44:44 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 341730gitlab # [ 337.338628] gitaly[896]: time="2026-08-29T13:44:44.143Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=3 command.system_time_ms=6 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M16W7Y8SBRTX4B3F96VFNYMX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-29T13:44:44.124" grpc.time_ms=18.383 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc1731gitlab # [ 337.360400] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:44:44 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 861732gitlab # [ 337.415188] gitaly[896]: time="2026-08-29T13:44:44.219Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M16W7YAABSFZ1CZT5FTBS46S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-29T13:44:44.208" grpc.time_ms=10.214 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1733gitlab # [ 337.429339] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:44:44 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 1121734gitlab # Enumerating objects: 5, done.1735gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1736gitlab # Delta compression using up to 4 threads1737gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1738gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 273.00 KiB/s, done.1739gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1740gitlab # [ 337.502043] gitaly[896]: time="2026-08-29T13:44:44.306Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M16W7YBPRMQ3RZQZDPAF8HZP grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-29T13:44:44.294" pid=896 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1741gitlab # [ 337.523276] gitaly[896]: time="2026-08-29T13:44:44.317Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M16W7YBPRMQ3RZQZDPAF8HZP grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-29T13:44:44.294" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc1742gitlab # [ 337.542656] gitlab-workhorse[822]: time="2026-08-29T13:44:44Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131743gitlab # [ 337.545031] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:44:44 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 1731744gitlab # [ 337.547422] gitaly[896]: time="2026-08-29T13:44:44.317Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M16W7YBPRMQ3RZQZDPAF8HZP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-29T13:44:44.294" grpc.time_ms=22.696 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc1745gitlab # [ 337.602225] gitaly[896]: time="2026-08-29T13:44:44.407Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M16W7YH8MDJYR5ZA3D96G35V grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-29T13:44:44.388" pid=896 remote_ip="2001:db8:1::1" request_sha=2b0cd290b864ce361c87bcbd7d9d7baa6b449e56 response_bytes=223 span.kind=server system=grpc1746gitlab # [ 337.617179] gitaly[896]: time="2026-08-29T13:44:44.421Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1140 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M16W7YH8MDJYR5ZA3D96G35V grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-29T13:44:44.388" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc1747gitlab # [ 337.635275] gitaly[896]: time="2026-08-29T13:44:44.421Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1140 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M16W7YH8MDJYR5ZA3D96G35V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-29T13:44:44.388" grpc.time_ms=33.139 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc1748gitlab # [ 337.653659] gitlab-workhorse[822]: time="2026-08-29T13:44:44Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2231749gitlab # [ 337.655718] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:44:44 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 931750gitlab # [ 337.720644] gitaly[896]: time="2026-08-29T13:44:44.525Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=302 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=5 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M16W7YEZ388PJ3RN04JJE16S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-29T13:45:14.013" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-29T13:44:44.513" grpc.time_ms=11.673 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1751gitlab # [ 337.752423] gitaly[896]: time="2026-08-29T13:44:44.538Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M16W7YNVK0Q8PBNGMKDDTF9V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-29T13:44:44.531" grpc.time_ms=6.479 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc1752gitlab # [ 337.776158] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:44:44 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 621753gitlab # [ 337.779270] gitaly[896]: time="2026-08-29T13:44:44.570Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M16W7YEZ388PJ3RN04JJE16S duration_ms=112ns method=POST pid=896 status=200 url="http://unix/api/v4/internal/allowed"1754gitlab # [ 337.806273] gitaly[896]: time="2026-08-29T13:44:44.611Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M16W7YEZ388PJ3RN04JJE16S duration_ms=40ns method=POST pid=896 status=200 url="http://unix/api/v4/internal/pre_receive"1755gitlab # [ 337.812517] gitaly[896]: time="2026-08-29T13:44:44.611Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M16W7YEZ388PJ3RN04JJE16S grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-29T13:44:44.456" grpc.time_ms=154.803 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1756gitlab # [ 337.835168] gitaly[896]: time="2026-08-29T13:44:44.639Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M16W7YEZ388PJ3RN04JJE16S grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-29T13:44:44.638" grpc.time_ms=0.533 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1757gitlab # [ 337.878567] gitaly[896]: time="2026-08-29T13:44:44.683Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M16W7YEZ388PJ3RN04JJE16S grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-29T13:44:44.683" grpc.time_ms=0.368 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1758gitlab # [ 337.894918] gitaly[896]: time="2026-08-29T13:44:44.683Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M16W7YQVPZNV29D53GZ9HA0J grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-29T13:44:44.670" pid=896 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1759gitlab # [ 337.909766] gitlab-workhorse[822]: time="2026-08-29T13:44:44Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671760gitlab # [ 337.913641] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:44:44 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1471761gitlab # [ 337.915869] gitaly[896]: time="2026-08-29T13:44:44.683Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M16W7YQVPZNV29D53GZ9HA0J grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-29T13:44:44.670" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc1762gitlab # [ 337.931031] gitaly[896]: time="2026-08-29T13:44:44.683Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M16W7YQVPZNV29D53GZ9HA0J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-29T13:44:44.670" grpc.time_ms=13.688 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc1763gitlab # [ 337.949277] gitaly[896]: time="2026-08-29T13:44:44.715Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M16W7YEZ388PJ3RN04JJE16S grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-29T13:44:44.715" grpc.time_ms=0.414 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1764gitlab # [ 338.031727] gitaly[896]: time="2026-08-29T13:44:44.836Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=12 command.system_time_ms=3 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M16W7YXXBCWC6GT559CE80PP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=194 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-29T13:44:44.817" grpc.time_ms=18.598 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc1765gitlab # [ 338.052383] gitaly[896]: time="2026-08-29T13:44:44.851Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M16W7YEZ388PJ3RN04JJE16S duration_ms=105ns method=POST pid=896 status=200 url="http://unix/api/v4/internal/post_receive"1766gitlab # [ 338.055511] gitaly[896]: time="2026-08-29T13:44:44.852Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M16W7YEZ388PJ3RN04JJE16S grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-29T13:44:44.744" grpc.time_ms=107.32 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1767gitlab # [ 338.066826] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:44:44 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1041768gitlab # [ 338.069046] gitlab-workhorse[822]: time="2026-08-29T13:44:44Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521769gitlab # To http://gitlab/root/test-flake.git1770gitlab # [ 338.071101] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:44:44 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 6151771gitlab # 00271b6..a868350 [ 338.074256] gitaly[896]: time="2026-08-29T13:44:44.870Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M16W7YEZ388PJ3RN04JJE16S diskcache=2d107fb7-2491-46c4-8bd3-5249fd1cbf83 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-29T13:44:44.379" pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1772gitlab # master -> master[ 338.085179] gitaly[896]: time="2026-08-29T13:44:44.870Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=157 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=831488 command.minflt=13173 command.oublock=32 command.real_time_ms=484 command.spawn_token_fork_ms=1 command.system_time_ms=102 command.user_time_ms=55 component=gitaly.StreamServerInterceptor correlation_id=01M16W7YEZ388PJ3RN04JJE16S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=58 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-29T13:44:44.379" grpc.time_ms=490.946 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1773gitlab # 1774gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.92 seconds)1775gitlab: must succeed: git -C /tmp/test-flake rev-parse master1776gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.02 seconds)1777gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1778gitlab # [ 338.165238] gitaly[896]: time="2026-08-29T13:44:44.970Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M16W7Z1BH1GKK6N8BXZ2WKY7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-29T13:44:44.942" pid=896 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1779gitlab # [ 338.175671] gitaly[896]: time="2026-08-29T13:44:44.970Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1103 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M16W7Z1BH1GKK6N8BXZ2WKY7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-29T13:44:44.942" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc1780gitlab # [ 338.190502] gitlab-workhorse[822]: time="2026-08-29T13:44:44Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091781gitlab # [ 338.192631] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:44:44 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 1271782gitlab # [ 338.194646] gitaly[896]: time="2026-08-29T13:44:44.970Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1103 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M16W7Z1BH1GKK6N8BXZ2WKY7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-29T13:44:44.942" grpc.time_ms=27.989 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc1783gitlab # [ 338.231108] nixbot[3547]: INFO: ::ffff:127.0.0.1:60876 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1784gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.09 seconds)1785gitlab # [ 338.310088] gitaly[896]: time="2026-08-29T13:44:45.114Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M16W7Z7SMMFVH6GZNDCJBA2F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-29T13:45:15.012" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:44:45.113" grpc.time_ms=0.929 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1786gitlab # [ 338.402134] gitaly[896]: time="2026-08-29T13:44:45.206Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=591 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M16W7Z7SMMFVH6GZNDCJBA2F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-29T13:45:15.087" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-29T13:44:45.187" grpc.time_ms=19.111 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1787gitlab # [ 338.486250] gitaly[896]: time="2026-08-29T13:44:45.291Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M16W7Z7SMMFVH6GZNDCJBA2F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-29T13:44:55.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-29T13:44:45.273" grpc.time_ms=17.422 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1788gitlab # [ 338.554276] gitaly[896]: time="2026-08-29T13:44:45.359Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=4 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M16W7Z7SMMFVH6GZNDCJBA2F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-29T13:44:55.070" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-29T13:44:45.341" grpc.time_ms=17.636 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1789gitlab # [ 338.713961] gitaly[896]: time="2026-08-29T13:44:45.518Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M16W7Z7SMMFVH6GZNDCJBA2F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-29T13:44:55.247" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-29T13:44:45.517" grpc.time_ms=0.625 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1790gitlab # [ 338.746985] gitaly[896]: time="2026-08-29T13:44:45.549Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=569 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M16W7Z7SMMFVH6GZNDCJBA2F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-29T13:44:55.262" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-29T13:44:45.533" grpc.time_ms=15.645 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1791gitlab # [ 338.817827] gitaly[896]: time="2026-08-29T13:44:45.622Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M16W7Z7SMMFVH6GZNDCJBA2F grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4151 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-29T13:44:45.620" grpc.time_ms=0.904 pid=896 span.kind=server system=grpc1792gitlab # [ 338.855709] gitaly[896]: time="2026-08-29T13:44:45.659Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M16W7Z7SMMFVH6GZNDCJBA2F grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4153 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-29T13:44:45.658" grpc.time_ms=0.865 pid=896 span.kind=server system=grpc1793gitlab # [ 338.882625] gitaly[896]: time="2026-08-29T13:44:45.673Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M16W7Z7SMMFVH6GZNDCJBA2F diskcache=6ea4a3a0-9899-4c05-9068-53a89272f7c8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-29T13:44:55.284" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-29T13:44:45.554" pid=896 ref=refs/keep-around/00271b64e0dc3f3d9dbebae68f634a97c7630b09 remote_ip="2001:db8:1::1" revision=00271b64e0dc3f3d9dbebae68f634a97c7630b09 span.kind=server system=grpc username=root1794gitlab # [ 338.905901] gitaly[896]: time="2026-08-29T13:44:45.673Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=112 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5358 command.oublock=8 command.real_time_ms=111 command.spawn_token_fork_ms=5 command.system_time_ms=82 command.user_time_ms=30 component=gitaly.UnaryServerInterceptor correlation_id=01M16W7Z7SMMFVH6GZNDCJBA2F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-29T13:44:55.284" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-29T13:44:45.554" grpc.time_ms=118.5 pid=896 ref=refs/keep-around/00271b64e0dc3f3d9dbebae68f634a97c7630b09 remote_ip="2001:db8:1::1" revision=00271b64e0dc3f3d9dbebae68f634a97c7630b09 span.kind=server system=grpc username=root1795gitlab # [ 338.930986] gitaly[896]: time="2026-08-29T13:44:45.680Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M16W7Z7SMMFVH6GZNDCJBA2F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-29T13:45:15.178" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:44:45.679" grpc.time_ms=0.835 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1796gitlab # [ 339.179504] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:44:45 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/00271b64e0dc3f3d9dbebae68f634a97c7630b09 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 9341797gitlab # [ 339.187926] nixbot[3547]: {"ts": "2026-08-29T13:44:45.986Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/00271b64e0dc3f3d9dbebae68f634a97c7630b09 \"HTTP/1.1 201 Created\""}1798gitlab # [ 339.196991] nixbot[3547]: {"ts": "2026-08-29T13:44:46.001Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-00271b64e0dc-0"}1799gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1800gitlab # [ 339.292380] nixbot[3547]: INFO: ::ffff:127.0.0.1:60888 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1801gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)1802gitlab # [ 339.491903] nixbot[3547]: {"ts": "2026-08-29T13:44:46.296Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-00271b64e0dc-0", "argv0": "bwrap"}1803gitlab # [ 339.652808] systemd[1]: Started Nix Daemon.1804gitlab # [ 339.754849] nix-daemon[3777]: accepted connection from pid 3772, user nixbot1805gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1806gitlab # [ 340.355271] nixbot[3547]: INFO: ::ffff:127.0.0.1:60898 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1807gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)1808gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1809gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)1810gitlab # [ 341.412186] nixbot[3547]: INFO: ::ffff:127.0.0.1:51784 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1811gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1812gitlab # [ 342.467200] nixbot[3547]: INFO: ::ffff:127.0.0.1:51800 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1813gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)1814gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1815gitlab # [ 343.523327] nixbot[3547]: INFO: ::ffff:127.0.0.1:51802 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1816gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)1817gitlab # [ 344.190029] nix-daemon[3777]: accepted connection from pid 3800, user nixbot1818gitlab # [ 344.222156] nix-daemon[3777]: accepted connection from pid 3772, user nixbot1819gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1820gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)1821gitlab # [ 344.579655] nixbot[3547]: INFO: ::ffff:127.0.0.1:51814 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1822gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1823gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.05 seconds)1824gitlab # [ 345.634594] nixbot[3547]: INFO: ::ffff:127.0.0.1:51830 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1825gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1826gitlab # [ 346.689416] nixbot[3547]: INFO: ::ffff:127.0.0.1:51846 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1827gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)1828gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1829gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)1830gitlab # [ 347.746915] nixbot[3547]: INFO: ::ffff:127.0.0.1:51848 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1831gitlab # [ 348.343311] nix-daemon[3777]: accepted connection from pid 3772, user nixbot1832gitlab # [ 348.555689] gitaly[896]: time="2026-08-29T13:44:55.359Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M16W8967TB6S020NE60BVF43 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-29T13:45:25.257" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:44:55.357" grpc.time_ms=1.38 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1833gitlab # [ 348.633232] gitaly[896]: time="2026-08-29T13:44:55.437Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M16W8967TB6S020NE60BVF43 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-29T13:45:05.151" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-29T13:44:55.421" grpc.time_ms=16.036 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1834gitlab # [ 348.739452] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:44:55 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/00271b64e0dc3f3d9dbebae68f634a97c7630b09 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 3031835gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1836gitlab # [ 348.748587] nixbot[3547]: {"ts": "2026-08-29T13:44:55.545Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/00271b64e0dc3f3d9dbebae68f634a97c7630b09 \"HTTP/1.1 201 Created\""}1837gitlab # [ 348.802495] nixbot[3547]: INFO: ::ffff:127.0.0.1:51852 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1838gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)1839gitlab # [ 348.843398] gitaly[896]: time="2026-08-29T13:44:55.648Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M16W89G1X0SQGYE35ACSEPKC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-29T13:45:25.146" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:44:55.646" grpc.time_ms=1.08 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1840gitlab # [ 348.897655] gitaly[896]: time="2026-08-29T13:44:55.702Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M16W89G1X0SQGYE35ACSEPKC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-29T13:45:05.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-29T13:44:55.687" grpc.time_ms=14.056 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1841gitlab # [ 348.968311] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:44:55 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/00271b64e0dc3f3d9dbebae68f634a97c7630b09 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2181842gitlab # [ 348.976595] nixbot[3547]: {"ts": "2026-08-29T13:44:55.774Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/00271b64e0dc3f3d9dbebae68f634a97c7630b09 \"HTTP/1.1 201 Created\""}1843gitlab # [ 349.105108] gitaly[896]: time="2026-08-29T13:44:55.909Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M16W89QJBP4YDCRFVGA0QP9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-29T13:45:25.307" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:44:55.908" grpc.time_ms=1.099 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1844gitlab # [ 349.422582] gitaly[896]: time="2026-08-29T13:44:56.227Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M16W89QJBP4YDCRFVGA0QP9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-29T13:45:06.141" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-29T13:44:56.211" grpc.time_ms=15.496 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1845gitlab # [ 349.571536] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:44:56 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/00271b64e0dc3f3d9dbebae68f634a97c7630b09 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 5811846gitlab # [ 349.581274] nixbot[3547]: {"ts": "2026-08-29T13:44:56.377Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/00271b64e0dc3f3d9dbebae68f634a97c7630b09 \"HTTP/1.1 201 Created\""}1847gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1848gitlab # [ 349.867843] nixbot[3547]: INFO: ::ffff:127.0.0.1:51864 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1849gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.08 seconds)1850gitlab # [ 349.916506] gitaly[896]: time="2026-08-29T13:44:56.720Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M16W8AG8R9SQVE2KASYEGT3Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-29T13:44:56.702" grpc.time_ms=17.421 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc1851gitlab # [ 349.951690] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:44:56 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1401852gitlab # [ 350.020082] gitaly[896]: time="2026-08-29T13:44:56.824Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M16W8AMRA4TMEY95VG7W7GGA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-29T13:44:56.806" pid=896 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1853gitlab # [ 350.049319] gitaly[896]: time="2026-08-29T13:44:56.824Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M16W8AMRA4TMEY95VG7W7GGA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-29T13:44:56.806" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc1854gitlab # [ 350.075081] gitlab-workhorse[822]: time="2026-08-29T13:44:56Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671855gitlab # [ 350.078152] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:44:56 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 971856gitlab # [ 350.081083] gitaly[896]: time="2026-08-29T13:44:56.825Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M16W8AMRA4TMEY95VG7W7GGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-29T13:44:56.806" grpc.time_ms=18.653 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc1857gitlab # [ 350.121166] gitaly[896]: time="2026-08-29T13:44:56.925Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M16W8AQXTPBYVD61YPBCTK48 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-29T13:44:56.897" pid=896 remote_ip="2001:db8:1::1" request_sha=68f8293b775265037e99bb3e94774727961cb833 response_bytes=337 span.kind=server system=grpc1858gitlab # [ 350.146811] gitaly[896]: time="2026-08-29T13:44:56.926Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=21 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1132 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=1 command.system_time_ms=12 command.user_time_ms=9 component=gitaly.UnaryServerInterceptor correlation_id=01M16W8AQXTPBYVD61YPBCTK48 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-29T13:44:56.897" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc1859gitlab # [ 350.176630] gitlab-workhorse[822]: time="2026-08-29T13:44:56Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3371860gitlab # [ 350.182153] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:44:56 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 337 "" "git/2.55.0" 981861gitlab # [ 350.185592] gitaly[896]: time="2026-08-29T13:44:56.926Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=21 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1132 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=1 command.system_time_ms=12 command.user_time_ms=9 component=gitaly.UnaryServerInterceptor correlation_id=01M16W8AQXTPBYVD61YPBCTK48 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-29T13:44:56.897" grpc.time_ms=28.476 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc1862gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1863gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)1864gitlab # [ 350.945690] nixbot[3547]: INFO: ::ffff:127.0.0.1:35550 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1865gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1866gitlab # [ 351.998383] nixbot[3547]: INFO: ::ffff:127.0.0.1:35560 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1867gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)1868gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1869gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.05 seconds)1870gitlab # [ 353.055362] nixbot[3547]: INFO: ::ffff:127.0.0.1:35574 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1871gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1872gitlab # [ 354.109208] nixbot[3547]: INFO: ::ffff:127.0.0.1:35590 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1873gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)1874gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1875gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.05 seconds)1876gitlab # [ 355.165644] nixbot[3547]: INFO: ::ffff:127.0.0.1:35600 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1877gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1878gitlab # [ 356.218511] nixbot[3547]: INFO: ::ffff:127.0.0.1:35616 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1879gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)1880gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1881gitlab # [ 357.275151] nixbot[3547]: INFO: ::ffff:127.0.0.1:35626 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1882gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)1883gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1884gitlab # [ 358.331317] nixbot[3547]: INFO: ::ffff:127.0.0.1:35628 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1885gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)1886gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1887gitlab # [ 359.387589] nixbot[3547]: INFO: ::ffff:127.0.0.1:35634 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1888gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)1889gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1890gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.05 seconds)1891gitlab # [ 360.443538] nixbot[3547]: INFO: ::ffff:127.0.0.1:35638 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1892gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1893gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.05 seconds)1894gitlab # [ 361.495986] nixbot[3547]: INFO: ::ffff:127.0.0.1:43436 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1895gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1896gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.05 seconds)1897gitlab # [ 362.548534] nixbot[3547]: INFO: ::ffff:127.0.0.1:43438 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1898gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1899gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.05 seconds)1900gitlab # [ 363.602846] nixbot[3547]: INFO: ::ffff:127.0.0.1:43450 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1901gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1902gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.05 seconds)1903gitlab # [ 364.651463] nixbot[3547]: INFO: ::ffff:127.0.0.1:43460 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1904gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1905gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)1906gitlab # [ 365.705181] nixbot[3547]: INFO: ::ffff:127.0.0.1:43472 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1907gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1908gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.05 seconds)1909gitlab # [ 366.761043] nixbot[3547]: INFO: ::ffff:127.0.0.1:43482 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1910gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1911gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.05 seconds)1912gitlab # [ 367.814824] nixbot[3547]: INFO: ::ffff:127.0.0.1:43492 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1913gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1914gitlab # [ 368.864839] nixbot[3547]: INFO: ::ffff:127.0.0.1:43506 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1915gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.05 seconds)1916gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1917gitlab # [ 369.921080] nixbot[3547]: INFO: ::ffff:127.0.0.1:43512 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1918gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)1919gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1920gitlab # [ 370.976224] nixbot[3547]: INFO: ::ffff:127.0.0.1:51198 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1921gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)1922gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1923gitlab # [ 372.031932] nixbot[3547]: INFO: ::ffff:127.0.0.1:51208 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1924gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)1925gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1926gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.04 seconds)1927gitlab # [ 373.079085] nixbot[3547]: INFO: ::ffff:127.0.0.1:51212 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1928gitlab # [ 373.141241] sidekiq-cluster[3497]: 2026-08-29T13:45:19.944Z pid=3497 tid=ykh INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>3497, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>425730048}1929gitlab # [ 373.414846] sidekiq-cluster[3497]: W, [2026-08-29T13:45:20.219639 #3497] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1930gitlab # [ 373.548747] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:45:20.353Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1931gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1932gitlab # [ 374.133675] nixbot[3547]: INFO: ::ffff:127.0.0.1:51216 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1933gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)1934gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1935gitlab # [ 375.190015] nixbot[3547]: INFO: ::ffff:127.0.0.1:51232 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1936gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)1937gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1938gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.05 seconds)1939gitlab # [ 376.246799] nixbot[3547]: INFO: ::ffff:127.0.0.1:51244 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1940gitlab # [ 376.609399] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:45:23.413Z","message":"GitLab reliable fetch activated!"}1941gitlab # [ 376.614465] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:45:23.413Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1942gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1943gitlab # [ 377.286838] nixbot[3547]: INFO: ::ffff:127.0.0.1:51252 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1944gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.04 seconds)1945gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1946gitlab # [ 378.342265] nixbot[3547]: INFO: ::ffff:127.0.0.1:51264 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1947gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)1948gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1949gitlab # [ 379.398267] nixbot[3547]: INFO: ::ffff:127.0.0.1:51276 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1950gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)1951gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1952gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.05 seconds)1953gitlab # [ 380.453705] nixbot[3547]: INFO: ::ffff:127.0.0.1:51282 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1954gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1955gitlab # [ 381.508682] nixbot[3547]: INFO: ::ffff:127.0.0.1:51822 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1956gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)1957gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1958gitlab # [ 382.566306] nixbot[3547]: INFO: ::ffff:127.0.0.1:51838 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1959gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)1960gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1961gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.05 seconds)1962gitlab # [ 383.623543] nixbot[3547]: INFO: ::ffff:127.0.0.1:51842 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1963gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1964gitlab # [ 384.677830] nixbot[3547]: INFO: ::ffff:127.0.0.1:51854 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1965gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)1966gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1967gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.05 seconds)1968gitlab # [ 385.735431] nixbot[3547]: INFO: ::ffff:127.0.0.1:51858 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1969gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1970gitlab # [ 386.789929] nixbot[3547]: INFO: ::ffff:127.0.0.1:51860 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1971gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)1972gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1973gitlab # [ 387.847380] nixbot[3547]: INFO: ::ffff:127.0.0.1:51866 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1974gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)1975gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1976gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.05 seconds)1977gitlab # [ 388.903636] nixbot[3547]: INFO: ::ffff:127.0.0.1:51874 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1978gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1979gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.05 seconds)1980gitlab # [ 389.957446] nixbot[3547]: INFO: ::ffff:127.0.0.1:51886 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1981gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1982gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.05 seconds)1983gitlab # [ 391.011306] nixbot[3547]: INFO: ::ffff:127.0.0.1:41498 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1984gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1985gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.05 seconds)1986gitlab # [ 392.065043] nixbot[3547]: INFO: ::ffff:127.0.0.1:41500 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1987gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1988gitlab # [ 393.119318] nixbot[3547]: INFO: ::ffff:127.0.0.1:41502 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1989gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)1990gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1991gitlab # [ 394.174821] nixbot[3547]: INFO: ::ffff:127.0.0.1:41510 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1992gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)1993gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1994gitlab # [ 395.230071] nixbot[3547]: INFO: ::ffff:127.0.0.1:41516 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1995gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)1996gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'1997gitlab # [ 396.285958] nixbot[3547]: INFO: ::ffff:127.0.0.1:41522 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK1998gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)1999gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'2000gitlab # [ 397.342693] nixbot[3547]: INFO: ::ffff:127.0.0.1:41530 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK2001gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)2002gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'2003gitlab # [ 398.398835] nixbot[3547]: INFO: ::ffff:127.0.0.1:41536 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK2004gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)2005gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'2006gitlab # [ 399.455629] nixbot[3547]: INFO: ::ffff:127.0.0.1:41552 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK2007gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)2008gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'2009gitlab # [ 400.511826] nixbot[3547]: INFO: ::ffff:127.0.0.1:41556 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK2010gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)2011gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'2012gitlab # [ 401.563168] nixbot[3547]: INFO: ::ffff:127.0.0.1:36048 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK2013gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.05 seconds)2014gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'2015gitlab # [ 402.620211] nixbot[3547]: INFO: ::ffff:127.0.0.1:36050 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK2016gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)2017gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'2018gitlab # [ 403.675864] nixbot[3547]: INFO: ::ffff:127.0.0.1:36060 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK2019gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)2020gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'2021gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.05 seconds)2022gitlab # [ 404.731982] nixbot[3547]: INFO: ::ffff:127.0.0.1:36062 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK2023gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'2024gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.05 seconds)2025gitlab # [ 405.785752] nixbot[3547]: INFO: ::ffff:127.0.0.1:36074 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK2026gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'2027gitlab # [ 406.834259] nixbot[3547]: INFO: ::ffff:127.0.0.1:36080 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK2028gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.05 seconds)2029gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'2030gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.05 seconds)2031gitlab # [ 407.886131] nixbot[3547]: INFO: ::ffff:127.0.0.1:36092 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK2032gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'2033gitlab # [ 408.937914] nixbot[3547]: INFO: ::ffff:127.0.0.1:36096 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK2034gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)2035gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'2036gitlab # [ 409.994688] nixbot[3547]: INFO: ::ffff:127.0.0.1:36112 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK2037gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)2038gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'2039gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.05 seconds)2040gitlab # [ 411.052947] nixbot[3547]: INFO: ::ffff:127.0.0.1:55776 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK2041gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'2042gitlab # [ 412.106502] nixbot[3547]: INFO: ::ffff:127.0.0.1:55778 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK2043gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)2044gitlab # [ 412.840348] postgres[4077]: [4077] ERROR: relation "table_without_models" does not exist2045gitlab # [ 412.840710] postgres[4077]: [4077] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')2046gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'2047gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.05 seconds)2048gitlab # [ 413.163046] nixbot[3547]: INFO: ::ffff:127.0.0.1:55782 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK2049gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'2050gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.05 seconds)2051gitlab # [ 414.217083] nixbot[3547]: INFO: ::ffff:127.0.0.1:55798 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK2052gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'2053gitlab # [ 415.269928] nixbot[3547]: INFO: ::ffff:127.0.0.1:55812 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK2054gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)2055gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'2056gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.05 seconds)2057gitlab # [ 416.326637] nixbot[3547]: INFO: ::ffff:127.0.0.1:55828 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK2058gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'2059gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.05 seconds)2060gitlab # [ 417.381873] nixbot[3547]: INFO: ::ffff:127.0.0.1:55838 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK2061gitlab # [ 417.599938] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:04.404Z","message":"Booted Rails 7.2.3.1 application in production environment"}2062gitlab # [ 417.604993] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:04.409Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}2063gitlab # [ 417.606992] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:04.409Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}2064gitlab # [ 417.608793] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:04.410Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}2065gitlab # [ 417.610728] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:04.413Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2066gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'2067gitlab # [ 418.437970] nixbot[3547]: INFO: ::ffff:127.0.0.1:55840 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK2068gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)2069gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'2070gitlab # [ 419.493522] nixbot[3547]: INFO: ::ffff:127.0.0.1:55842 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK2071gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)2072gitlab # [ 420.259737] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:07.062Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"644e5e78c5950c4889b387f0","created_at":"2026-08-29T13:44:35.981Z","trace_propagation_headers":{"sentry-trace":"c8c8204dce104f7aa6270405a93c9bf3-a273a25b7f8444bb","baggage":"sentry-trace_id=c8c8204dce104f7aa6270405a93c9bf3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M16W7M7WHJYQ9W77ZVD7EYAR","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:36.038Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-644e5e78c5950c4889b387f0: start","job_status":"start","queue_duration_s":91.024459,"scheduling_latency_s":91.024572}2073gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'2074gitlab # [ 420.549553] nixbot[3547]: INFO: ::ffff:127.0.0.1:55854 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK2075gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.05 seconds)2076gitlab # [ 420.640195] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:07.444Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"644e5e78c5950c4889b387f0","created_at":"2026-08-29T13:44:35.981Z","trace_propagation_headers":{"sentry-trace":"c8c8204dce104f7aa6270405a93c9bf3-a273a25b7f8444bb","baggage":"sentry-trace_id=c8c8204dce104f7aa6270405a93c9bf3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M16W7M7WHJYQ9W77ZVD7EYAR","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:36.038Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-644e5e78c5950c4889b387f0: done: 0.381755 sec","job_status":"done","queue_duration_s":91.024459,"scheduling_latency_s":91.024572,"redis_calls":23,"redis_duration_s":0.010709,"redis_read_bytes":910,"redis_write_bytes":2540,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.005917,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002784,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002008,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.19709,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.19728304,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.381755,"completed_at":"2026-08-29T13:46:07.443Z","load_balancing_strategy":"primary","db_duration_s":0.104994,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2077gitlab # [ 420.740490] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:07.446Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"e840bc367a8a7ff4d193a5e5","created_at":"2026-08-29T13:44:36.061Z","trace_propagation_headers":{"sentry-trace":"c8c8204dce104f7aa6270405a93c9bf3-a273a25b7f8444bb","baggage":"sentry-trace_id=c8c8204dce104f7aa6270405a93c9bf3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M16W7M7WHJYQ9W77ZVD7EYAR","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:36.069Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-e840bc367a8a7ff4d193a5e5: start","job_status":"start","queue_duration_s":91.377146,"scheduling_latency_s":91.377182}2078gitlab # [ 420.812585] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:07.616Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"e840bc367a8a7ff4d193a5e5","created_at":"2026-08-29T13:44:36.061Z","trace_propagation_headers":{"sentry-trace":"c8c8204dce104f7aa6270405a93c9bf3-a273a25b7f8444bb","baggage":"sentry-trace_id=c8c8204dce104f7aa6270405a93c9bf3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M16W7M7WHJYQ9W77ZVD7EYAR","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:36.069Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-e840bc367a8a7ff4d193a5e5: done: 0.169549 sec","job_status":"done","queue_duration_s":91.377146,"scheduling_latency_s":91.377182,"redis_calls":14,"redis_duration_s":0.004687,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000892,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002313,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001482,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.123877,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.13142796,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.169549,"completed_at":"2026-08-29T13:46:07.616Z","load_balancing_strategy":"primary","db_duration_s":0.035334,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2079gitlab # [ 420.910396] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:07.618Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"7dee9de7aaaf1863f17a28e4","created_at":"2026-08-29T13:44:36.822Z","trace_propagation_headers":{"sentry-trace":"c8c8204dce104f7aa6270405a93c9bf3-a273a25b7f8444bb","baggage":"sentry-trace_id=c8c8204dce104f7aa6270405a93c9bf3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M16W7M7WHJYQ9W77ZVD7EYAR","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:36.830Z","job_size_bytes":5,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-7dee9de7aaaf1863f17a28e4: start","job_status":"start","queue_duration_s":90.787882,"scheduling_latency_s":90.787908}2080gitlab # [ 421.081382] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:07.885Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"7dee9de7aaaf1863f17a28e4","created_at":"2026-08-29T13:44:36.822Z","trace_propagation_headers":{"sentry-trace":"c8c8204dce104f7aa6270405a93c9bf3-a273a25b7f8444bb","baggage":"sentry-trace_id=c8c8204dce104f7aa6270405a93c9bf3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M16W7M7WHJYQ9W77ZVD7EYAR","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:36.830Z","job_size_bytes":5,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-7dee9de7aaaf1863f17a28e4: done: 0.266603 sec","job_status":"done","queue_duration_s":90.787882,"scheduling_latency_s":90.787908,"redis_calls":12,"redis_duration_s":0.004063,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000856,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00269,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000517,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.216882,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036142,"duration_s":0.266603,"completed_at":"2026-08-29T13:46:07.885Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.041859,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2081gitlab # [ 421.174879] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:07.887Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"6973a60c1d0d80ad40879186","created_at":"2026-08-29T13:44:36.867Z","trace_propagation_headers":{"sentry-trace":"c8c8204dce104f7aa6270405a93c9bf3-a273a25b7f8444bb","baggage":"sentry-trace_id=c8c8204dce104f7aa6270405a93c9bf3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M16W7M7WHJYQ9W77ZVD7EYAR","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:36.872Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-6973a60c1d0d80ad40879186: start","job_status":"start","queue_duration_s":91.015082,"scheduling_latency_s":91.015108}2082gitlab # [ 421.365622] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:08.168Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"6973a60c1d0d80ad40879186","created_at":"2026-08-29T13:44:36.867Z","trace_propagation_headers":{"sentry-trace":"c8c8204dce104f7aa6270405a93c9bf3-a273a25b7f8444bb","baggage":"sentry-trace_id=c8c8204dce104f7aa6270405a93c9bf3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M16W7M7WHJYQ9W77ZVD7EYAR","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:36.872Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-6973a60c1d0d80ad40879186: done: 0.280835 sec","job_status":"done","queue_duration_s":91.015082,"scheduling_latency_s":91.015108,"redis_calls":11,"redis_duration_s":0.003323,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000827,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001833,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000663,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.041,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.236,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.236,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.039,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.176562,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00061836,"duration_s":0.280835,"completed_at":"2026-08-29T13:46:08.168Z","load_balancing_strategy":"primary","db_duration_s":0.107613,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2083gitlab # [ 421.472930] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:08.171Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"1a151495fa2f494a7e9e4a15","created_at":"2026-08-29T13:44:36.876Z","trace_propagation_headers":{"sentry-trace":"c8c8204dce104f7aa6270405a93c9bf3-a273a25b7f8444bb","baggage":"sentry-trace_id=c8c8204dce104f7aa6270405a93c9bf3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M16W7M7WHJYQ9W77ZVD7EYAR","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:36.882Z","job_size_bytes":89,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-1a151495fa2f494a7e9e4a15: start","job_status":"start","queue_duration_s":91.288874,"scheduling_latency_s":91.288901}2084gitlab # [ 421.497657] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:08.222Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"1a151495fa2f494a7e9e4a15","created_at":"2026-08-29T13:44:36.876Z","trace_propagation_headers":{"sentry-trace":"c8c8204dce104f7aa6270405a93c9bf3-a273a25b7f8444bb","baggage":"sentry-trace_id=c8c8204dce104f7aa6270405a93c9bf3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M16W7M7WHJYQ9W77ZVD7EYAR","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:36.882Z","job_size_bytes":89,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-1a151495fa2f494a7e9e4a15: done: 0.051238 sec","job_status":"done","queue_duration_s":91.288874,"scheduling_latency_s":91.288901,"redis_calls":11,"redis_duration_s":0.0034389999999999998,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001189,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001702,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000548,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032441,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00041174,"duration_s":0.051238,"completed_at":"2026-08-29T13:46:08.222Z","load_balancing_strategy":"primary","db_duration_s":0.009403,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2085gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'2086gitlab # [ 421.546448] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:08.224Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 00271b64e0dc3f3d9dbebae68f634a97c7630b09 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"178db66e4ac7c316475945a7","created_at":"2026-08-29T13:44:39.322Z","trace_propagation_headers":{"sentry-trace":"c3363060204f4669b7cc50d700349846-ae47e0e95e684137","baggage":"sentry-trace_id=c3363060204f4669b7cc50d700349846,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M16W7R5X03E0YY4H97G573W6","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:39.331Z","job_size_bytes":185,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-178db66e4ac7c316475945a7: start","job_status":"start","queue_duration_s":88.892373,"scheduling_latency_s":88.892394}2087gitlab # [ 421.562670] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:08.244Z","message":"changes: \"0000000000000000000000000000000000000000 00271b64e0dc3f3d9dbebae68f634a97c7630b09 refs/heads/master\\n\""}2088gitlab # [ 421.565520] gitaly[896]: time="2026-08-29T13:46:08.296Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=576 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=1 command.system_time_ms=11 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M16W7R5X03E0YY4H97G573W6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-29T13:46:18.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-29T13:46:08.277" grpc.time_ms=18.655 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2089gitlab # [ 421.578663] gitaly[896]: time="2026-08-29T13:46:08.320Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M16W7R5X03E0YY4H97G573W6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-29T13:46:18.032" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-29T13:46:08.302" grpc.time_ms=17.143 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2090gitlab # [ 421.597147] gitaly[896]: time="2026-08-29T13:46:08.402Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=4 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M16W7R5X03E0YY4H97G573W6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-29T13:46:18.113" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-29T13:46:08.383" grpc.time_ms=18.207 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2091gitlab # [ 421.618997] nixbot[3547]: INFO: ::ffff:127.0.0.1:46578 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK2092gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.07 seconds)2093gitlab # [ 421.644514] gitaly[896]: time="2026-08-29T13:46:08.449Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M16W7R5X03E0YY4H97G573W6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3934 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-29T13:46:08.448" grpc.time_ms=0.436 pid=896 span.kind=server system=grpc2094gitlab # [ 421.699897] gitaly[896]: time="2026-08-29T13:46:08.504Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M16W7R5X03E0YY4H97G573W6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3936 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-29T13:46:08.504" grpc.time_ms=0.525 pid=896 span.kind=server system=grpc2095gitlab # [ 421.718488] gitaly[896]: time="2026-08-29T13:46:08.518Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M16W7R5X03E0YY4H97G573W6 diskcache=82ac94e4-c153-463c-92d4-c704a092fe70 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-29T13:46:18.143" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-29T13:46:08.414" pid=896 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2096gitlab # [ 421.735707] gitaly[896]: time="2026-08-29T13:46:08.519Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=109 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5167 command.oublock=8 command.real_time_ms=96 command.spawn_token_fork_ms=3 command.system_time_ms=75 command.user_time_ms=34 component=gitaly.UnaryServerInterceptor correlation_id=01M16W7R5X03E0YY4H97G573W6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-29T13:46:18.143" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-29T13:46:08.414" grpc.time_ms=104.695 pid=896 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2097gitlab # [ 421.754511] gitaly[896]: time="2026-08-29T13:46:08.547Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M16W7R5X03E0YY4H97G573W6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-29T13:46:18.276" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-29T13:46:08.547" grpc.time_ms=0.29 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2098gitlab # [ 421.773185] gitaly[896]: time="2026-08-29T13:46:08.578Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=859 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=3 command.system_time_ms=18 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M16W7R5X03E0YY4H97G573W6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-29T13:46:18.283" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-29T13:46:08.554" grpc.time_ms=23.778 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2099gitlab # [ 421.951283] gitaly[896]: time="2026-08-29T13:46:08.755Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=313 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M16W7R5X03E0YY4H97G573W6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-08-29T13:46:38.043" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:46:08.743" grpc.time_ms=11.839 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2100gitlab # [ 422.014908] gitaly[896]: time="2026-08-29T13:46:08.819Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M16W7R5X03E0YY4H97G573W6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-29T13:46:18.008" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-29T13:46:08.818" grpc.time_ms=0.615 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2101gitlab # [ 422.048306] gitaly[896]: time="2026-08-29T13:46:08.835Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=315 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M16W7R5X03E0YY4H97G573W6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-29T13:46:18.013" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-08-29T13:46:08.824" grpc.time_ms=11.096 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2102gitlab # [ 422.080670] gitaly[896]: time="2026-08-29T13:46:08.879Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M16W7R5X03E0YY4H97G573W6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-29T13:46:18.052" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-29T13:46:08.862" grpc.time_ms=16.815 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2103gitlab # [ 422.103471] gitaly[896]: time="2026-08-29T13:46:08.908Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M16W7R5X03E0YY4H97G573W6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-29T13:46:18.081" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-29T13:46:08.891" grpc.time_ms=16.463 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2104gitlab # [ 422.155009] gitaly[896]: time="2026-08-29T13:46:08.959Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=882 command.oublock=0 command.real_time_ms=22 command.spawn_token_fork_ms=3 command.system_time_ms=12 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M16W7R5X03E0YY4H97G573W6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-29T13:46:38.231" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:46:08.931" grpc.time_ms=27.725 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2105gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'2106gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)2107gitlab # [ 422.683498] nixbot[3547]: INFO: ::ffff:127.0.0.1:46594 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK2108gitlab # [ 422.728482] gitaly[896]: time="2026-08-29T13:46:09.532Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M16W7R5X03E0YY4H97G573W6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-29T13:46:19.259" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:46:09.530" grpc.time_ms=1.862 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2109gitlab # [ 422.768318] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:09.565Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 00271b64e0dc3f3d9dbebae68f634a97c7630b09 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"178db66e4ac7c316475945a7","created_at":"2026-08-29T13:44:39.322Z","trace_propagation_headers":{"sentry-trace":"c3363060204f4669b7cc50d700349846-ae47e0e95e684137","baggage":"sentry-trace_id=c3363060204f4669b7cc50d700349846,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M16W7R5X03E0YY4H97G573W6","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:39.331Z","job_size_bytes":185,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-178db66e4ac7c316475945a7: done: 1.341651 sec","job_status":"done","queue_duration_s":88.892373,"scheduling_latency_s":88.892394,"gitaly_calls":13,"gitaly_duration_s":0.322146,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.061902,"redis_read_bytes":2103,"redis_write_bytes":21749,"redis_cache_calls":15,"redis_cache_duration_s":0.006741,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.008988,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.001958,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7837,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.005758,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.025137,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.01332,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.086,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.309,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.359,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.086,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.877816,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00078786,"exclusive_lock_hold_duration_s":0.04003782,"duration_s":1.341651,"completed_at":"2026-08-29T13:46:09.565Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.151172,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2110gitlab # [ 422.854180] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:09.568Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","00271b64e0dc3f3d9dbebae68f634a97c7630b09 a868350d45cf235a21d84a90a239221281f6ba62 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"d1a5d9b4ad607941feafb665","created_at":"2026-08-29T13:44:44.804Z","trace_propagation_headers":{"sentry-trace":"5233baf4d15644ecacc820dd114971ef-b3122499c76e4d9e","baggage":"sentry-trace_id=5233baf4d15644ecacc820dd114971ef,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M16W7YEZ388PJ3RN04JJE16S","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:44.815Z","job_size_bytes":185,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-d1a5d9b4ad607941feafb665: start","job_status":"start","queue_duration_s":84.752378,"scheduling_latency_s":84.752398}2111gitlab # [ 422.872035] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:09.581Z","message":"changes: \"00271b64e0dc3f3d9dbebae68f634a97c7630b09 a868350d45cf235a21d84a90a239221281f6ba62 refs/heads/master\\n\""}2112gitlab # [ 422.875331] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:09.642Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"d269707e81de4c0f240d6d57","created_at":"2026-08-29T13:46:09.638Z","trace_propagation_headers":{"sentry-trace":"5233baf4d15644ecacc820dd114971ef-167c71901fd241f0","baggage":"sentry-trace_id=5233baf4d15644ecacc820dd114971ef,sentry-release=Unknown"},"correlation_id":"01M16W7YEZ388PJ3RN04JJE16S","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"1db0608116fabb417c80bb60","job_size_bytes":46,"pid":3497,"job_status":"deduplicated","message":"ProjectCacheWorker JID-d269707e81de4c0f240d6d57: deduplicated: until executing","deduplication.type":"until executing"}2113gitlab # [ 422.890354] gitaly[896]: time="2026-08-29T13:46:09.612Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M16W7YEZ388PJ3RN04JJE16S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-29T13:46:19.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-29T13:46:09.599" grpc.time_ms=12.998 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2114gitlab # [ 422.903411] gitaly[896]: time="2026-08-29T13:46:09.634Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M16W7YEZ388PJ3RN04JJE16S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-29T13:46:19.027" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-29T13:46:09.617" grpc.time_ms=16.083 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2115gitlab # [ 422.916919] gitaly[896]: time="2026-08-29T13:46:09.684Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M16W7YEZ388PJ3RN04JJE16S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-29T13:46:19.077" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-29T13:46:09.667" grpc.time_ms=16.487 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2116gitlab # [ 422.930359] gitaly[896]: time="2026-08-29T13:46:09.707Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M16W7YEZ388PJ3RN04JJE16S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-08-29T13:46:39.091" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:46:09.692" grpc.time_ms=15.026 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2117gitlab # [ 422.945651] gitaly[896]: time="2026-08-29T13:46:09.737Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=318 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M16W7YEZ388PJ3RN04JJE16S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-29T13:46:19.136" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-08-29T13:46:09.727" grpc.time_ms=10.515 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2118gitlab # [ 422.966735] gitaly[896]: time="2026-08-29T13:46:09.771Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M16W7YEZ388PJ3RN04JJE16S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-29T13:46:19.164" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-29T13:46:09.754" grpc.time_ms=16.717 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2119gitlab # [ 423.131572] gitaly[896]: time="2026-08-29T13:46:09.936Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M16W7YEZ388PJ3RN04JJE16S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-29T13:46:19.123" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:46:09.933" grpc.time_ms=2.604 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2120gitlab # [ 423.176505] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:09.979Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","00271b64e0dc3f3d9dbebae68f634a97c7630b09 a868350d45cf235a21d84a90a239221281f6ba62 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"d1a5d9b4ad607941feafb665","created_at":"2026-08-29T13:44:44.804Z","trace_propagation_headers":{"sentry-trace":"5233baf4d15644ecacc820dd114971ef-b3122499c76e4d9e","baggage":"sentry-trace_id=5233baf4d15644ecacc820dd114971ef,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M16W7YEZ388PJ3RN04JJE16S","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:44:44.815Z","job_size_bytes":185,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-d1a5d9b4ad607941feafb665: done: 0.411762 sec","job_status":"done","queue_duration_s":84.752378,"scheduling_latency_s":84.752398,"gitaly_calls":7,"gitaly_duration_s":0.117828,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.031411,"redis_read_bytes":500,"redis_write_bytes":11943,"redis_cache_calls":9,"redis_cache_duration_s":0.003471,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001444,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5720,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.005082,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.00932,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.012094,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.042,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.04,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.04,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.042,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.250691,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00073054,"exclusive_lock_hold_duration_s":0.02251278,"duration_s":0.411762,"completed_at":"2026-08-29T13:46:09.979Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.042967,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2121gitlab # [ 423.263826] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:09.983Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"cdac5caadc283a3826bf5443","created_at":"2026-08-29T13:44:45.694Z","trace_propagation_headers":{"sentry-trace":"7b85cacc0dde4852a7b61ab82d1509f7-b73f33fcec564e4e","baggage":"sentry-trace_id=7b85cacc0dde4852a7b61ab82d1509f7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M16W7Z7SMMFVH6GZNDCJBA2F","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:45.705Z","job_size_bytes":65,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-cdac5caadc283a3826bf5443: start","job_status":"start","queue_duration_s":84.277594,"scheduling_latency_s":84.277635}2122gitlab # [ 423.332421] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:10.136Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"cdac5caadc283a3826bf5443","created_at":"2026-08-29T13:44:45.694Z","trace_propagation_headers":{"sentry-trace":"7b85cacc0dde4852a7b61ab82d1509f7-b73f33fcec564e4e","baggage":"sentry-trace_id=7b85cacc0dde4852a7b61ab82d1509f7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M16W7Z7SMMFVH6GZNDCJBA2F","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:45.705Z","job_size_bytes":65,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-cdac5caadc283a3826bf5443: done: 0.15307 sec","job_status":"done","queue_duration_s":84.277594,"scheduling_latency_s":84.277635,"redis_calls":16,"redis_duration_s":0.00604,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.003053,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002196,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000791,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.103326,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00069886,"duration_s":0.15307,"completed_at":"2026-08-29T13:46:10.136Z","load_balancing_strategy":"primary","db_duration_s":0.03746,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2123gitlab # [ 423.419358] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:10.139Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"57793c4195fa1b7d08e5430e","created_at":"2026-08-29T13:44:45.707Z","trace_propagation_headers":{"sentry-trace":"7b85cacc0dde4852a7b61ab82d1509f7-b73f33fcec564e4e","baggage":"sentry-trace_id=7b85cacc0dde4852a7b61ab82d1509f7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M16W7Z7SMMFVH6GZNDCJBA2F","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:45.716Z","job_size_bytes":65,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-57793c4195fa1b7d08e5430e: start","job_status":"start","queue_duration_s":84.422149,"scheduling_latency_s":84.422178}2124gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'2125gitlab # [ 423.628366] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:10.432Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"57793c4195fa1b7d08e5430e","created_at":"2026-08-29T13:44:45.707Z","trace_propagation_headers":{"sentry-trace":"7b85cacc0dde4852a7b61ab82d1509f7-b73f33fcec564e4e","baggage":"sentry-trace_id=7b85cacc0dde4852a7b61ab82d1509f7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M16W7Z7SMMFVH6GZNDCJBA2F","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:45.716Z","job_size_bytes":65,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-57793c4195fa1b7d08e5430e: done: 0.293571 sec","job_status":"done","queue_duration_s":84.422149,"scheduling_latency_s":84.422178,"redis_calls":21,"redis_duration_s":0.006766,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.003056,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001859,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001851,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.044,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.032,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.22979,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00049978,"duration_s":0.293571,"completed_at":"2026-08-29T13:46:10.432Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.052619,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2126gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.07 seconds)2127gitlab # [ 423.740593] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:10.434Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"7a9b09d24f9b79ef47614d24","created_at":"2026-08-29T13:44:45.944Z","trace_propagation_headers":{"sentry-trace":"7b85cacc0dde4852a7b61ab82d1509f7-b73f33fcec564e4e","baggage":"sentry-trace_id=7b85cacc0dde4852a7b61ab82d1509f7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M16W7Z7SMMFVH6GZNDCJBA2F","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:45.954Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-7a9b09d24f9b79ef47614d24: start","job_status":"start","queue_duration_s":84.48037,"scheduling_latency_s":84.480393}2128gitlab # [ 423.767919] nixbot[3547]: INFO: ::ffff:127.0.0.1:46604 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK2129gitlab # [ 423.975548] gitaly[896]: time="2026-08-29T13:46:10.779Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M16W7Z7SMMFVH6GZNDCJBA2F grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3895 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-29T13:46:10.778" grpc.time_ms=0.829 pid=896 span.kind=server system=grpc2130gitlab # [ 424.028356] gitaly[896]: time="2026-08-29T13:46:10.833Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M16W7Z7SMMFVH6GZNDCJBA2F grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-29T13:46:10.832" grpc.time_ms=0.79 pid=896 span.kind=server system=grpc2131gitlab # [ 424.076868] gitaly[896]: time="2026-08-29T13:46:10.881Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M16W7Z7SMMFVH6GZNDCJBA2F grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3895 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-29T13:46:10.880" grpc.time_ms=0.793 pid=896 span.kind=server system=grpc2132gitlab # [ 424.107609] gitaly[896]: time="2026-08-29T13:46:10.894Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M16W7Z7SMMFVH6GZNDCJBA2F diskcache=19e8a150-fb38-4f98-9b10-76e404c32e0b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-29T13:46:40.019" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-29T13:46:10.719" pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2133gitlab # [ 424.129421] gitaly[896]: time="2026-08-29T13:46:10.895Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=195 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7534 command.oublock=0 command.real_time_ms=167 command.spawn_token_fork_ms=1 command.system_time_ms=98 command.user_time_ms=97 component=gitaly.UnaryServerInterceptor correlation_id=01M16W7Z7SMMFVH6GZNDCJBA2F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-29T13:46:40.019" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-29T13:46:10.719" grpc.time_ms=174.745 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2134gitlab # [ 424.299523] gitaly[896]: time="2026-08-29T13:46:11.104Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M16W7Z7SMMFVH6GZNDCJBA2F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-29T13:46:41.001" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:46:11.102" grpc.time_ms=1.674 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2135gitlab # [ 424.356283] gitaly[896]: time="2026-08-29T13:46:11.161Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M16W7Z7SMMFVH6GZNDCJBA2F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-29T13:46:41.058" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:46:11.159" grpc.time_ms=1.289 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2136gitlab # [ 424.404978] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:11.207Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"7a9b09d24f9b79ef47614d24","created_at":"2026-08-29T13:44:45.944Z","trace_propagation_headers":{"sentry-trace":"7b85cacc0dde4852a7b61ab82d1509f7-b73f33fcec564e4e","baggage":"sentry-trace_id=7b85cacc0dde4852a7b61ab82d1509f7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M16W7Z7SMMFVH6GZNDCJBA2F","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-29T13:44:45.954Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-7a9b09d24f9b79ef47614d24: done: 0.772929 sec","job_status":"done","queue_duration_s":84.48037,"scheduling_latency_s":84.480393,"gitaly_calls":3,"gitaly_duration_s":0.188335,"redis_calls":117,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.042841,"redis_read_bytes":457,"redis_write_bytes":28002,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002869,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001796,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.015479,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":25,"redis_queues_duration_s":0.005826,"redis_queues_read_bytes":36,"redis_queues_write_bytes":14496,"redis_queues_metadata_calls":21,"redis_queues_metadata_duration_s":0.008762,"redis_queues_metadata_read_bytes":32,"redis_queues_metadata_write_bytes":3370,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.001233,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000819,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003188,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.098,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.051,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.06,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.047,"db_ci_duration_s":0.051,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.44758,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.67784148,"duration_s":0.772929,"completed_at":"2026-08-29T13:46:11.207Z","load_balancing_strategy":"primary","db_duration_s":0.120649,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2137gitlab # [ 424.499073] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:11.210Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"1db0608116fabb417c80bb60","created_at":"2026-08-29T13:46:08.323Z","trace_propagation_headers":{"sentry-trace":"c3363060204f4669b7cc50d700349846-d4e21f6012c240ed","baggage":"sentry-trace_id=c3363060204f4669b7cc50d700349846,sentry-release=Unknown"},"correlation_id":"01M16W7R5X03E0YY4H97G573W6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:08.345Z","job_size_bytes":46,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-1db0608116fabb417c80bb60: start","job_status":"start","queue_duration_s":2.865441,"scheduling_latency_s":2.86548}2138gitlab # [ 424.516256] gitaly[896]: time="2026-08-29T13:46:11.307Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M16W7R5X03E0YY4H97G573W6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-08-29T19:46:11.296" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-29T13:46:11.297" grpc.time_ms=10.012 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2139gitlab # [ 424.532059] gitaly[896]: time="2026-08-29T13:46:11.336Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M16W7R5X03E0YY4H97G573W6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-29T13:46:41.220" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:46:11.320" grpc.time_ms=15.73 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2140gitlab # [ 424.579722] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:11.383Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"1db0608116fabb417c80bb60","created_at":"2026-08-29T13:46:08.323Z","trace_propagation_headers":{"sentry-trace":"c3363060204f4669b7cc50d700349846-d4e21f6012c240ed","baggage":"sentry-trace_id=c3363060204f4669b7cc50d700349846,sentry-release=Unknown"},"correlation_id":"01M16W7R5X03E0YY4H97G573W6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:08.345Z","job_size_bytes":46,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-1db0608116fabb417c80bb60: done: 0.17281 sec","job_status":"done","queue_duration_s":2.865441,"scheduling_latency_s":2.86548,"gitaly_calls":2,"gitaly_duration_s":0.032655,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.010872,"redis_read_bytes":69,"redis_write_bytes":4887,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.002177,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000917,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2115,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002373,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.00426,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001145,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.110884,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004876,"duration_s":0.17281,"completed_at":"2026-08-29T13:46:11.383Z","load_balancing_strategy":"primary","db_duration_s":0.019149,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2141gitlab # [ 424.658142] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:11.386Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"84a274306a1daa03e6dc7787","created_at":"2026-08-29T13:46:08.369Z","trace_propagation_headers":{"sentry-trace":"c3363060204f4669b7cc50d700349846-d4e21f6012c240ed","baggage":"sentry-trace_id=c3363060204f4669b7cc50d700349846,sentry-release=Unknown"},"correlation_id":"01M16W7R5X03E0YY4H97G573W6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:08.377Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-84a274306a1daa03e6dc7787: start","job_status":"start","queue_duration_s":3.008662,"scheduling_latency_s":3.008689}2142gitlab # [ 424.679292] gitaly[896]: time="2026-08-29T13:46:11.455Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M16W7R5X03E0YY4H97G573W6 diskcache=795a508f-2120-4987-9cf4-3bf3759c52fd grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-29T19:46:11.419" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:46:11.419" pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2143gitlab # [ 424.691523] gitaly[896]: time="2026-08-29T13:46:11.456Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=25 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1174 command.oublock=0 command.real_time_ms=43 command.spawn_token_fork_ms=3 command.system_time_ms=17 command.user_time_ms=8 component=gitaly.UnaryServerInterceptor correlation_id=01M16W7R5X03E0YY4H97G573W6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-29T19:46:11.419" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:46:11.419" grpc.time_ms=36.114 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2144gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'2145gitlab # [ 424.733704] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:11.536Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"84a274306a1daa03e6dc7787","created_at":"2026-08-29T13:46:08.369Z","trace_propagation_headers":{"sentry-trace":"c3363060204f4669b7cc50d700349846-d4e21f6012c240ed","baggage":"sentry-trace_id=c3363060204f4669b7cc50d700349846,sentry-release=Unknown"},"correlation_id":"01M16W7R5X03E0YY4H97G573W6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:08.377Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-84a274306a1daa03e6dc7787: done: 0.150833 sec","job_status":"done","queue_duration_s":3.008662,"scheduling_latency_s":3.008689,"gitaly_calls":1,"gitaly_duration_s":0.03929,"redis_calls":15,"redis_duration_s":0.00464,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000571,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001681,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000841,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001547,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.023,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.044,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.077886,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.1117795,"duration_s":0.150833,"completed_at":"2026-08-29T13:46:11.536Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027157,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2146gitlab # [ 424.796591] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:11.541Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"f617b98cd327d5d8f4b50448","created_at":"2026-08-29T13:46:08.539Z","trace_propagation_headers":{"sentry-trace":"c3363060204f4669b7cc50d700349846-d4e21f6012c240ed","baggage":"sentry-trace_id=c3363060204f4669b7cc50d700349846,sentry-release=Unknown"},"correlation_id":"01M16W7R5X03E0YY4H97G573W6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:08.542Z","job_size_bytes":23,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-f617b98cd327d5d8f4b50448: start","job_status":"start","queue_duration_s":2.998662,"scheduling_latency_s":2.998703}2147gitlab # [ 424.813630] gitaly[896]: time="2026-08-29T13:46:11.615Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=594 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M16W7R5X03E0YY4H97G573W6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-29T13:46:41.499" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:46:11.599" grpc.time_ms=15.988 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2148gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.07 seconds)2149gitlab # [ 424.827915] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:11.632Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"f617b98cd327d5d8f4b50448","created_at":"2026-08-29T13:46:08.539Z","trace_propagation_headers":{"sentry-trace":"c3363060204f4669b7cc50d700349846-d4e21f6012c240ed","baggage":"sentry-trace_id=c3363060204f4669b7cc50d700349846,sentry-release=Unknown"},"correlation_id":"01M16W7R5X03E0YY4H97G573W6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:08.542Z","job_size_bytes":23,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-f617b98cd327d5d8f4b50448: done: 0.090929 sec","job_status":"done","queue_duration_s":2.998662,"scheduling_latency_s":2.998703,"gitaly_calls":1,"gitaly_duration_s":0.018968,"redis_calls":16,"redis_duration_s":0.00952,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000408,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001656,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.006286,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00117,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.052402,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.090929,"completed_at":"2026-08-29T13:46:11.632Z","load_balancing_strategy":"primary","db_duration_s":0.005794,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2150gitlab # [ 424.873883] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:11.636Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"8846151e2a9caf2754cb8316","created_at":"2026-08-29T13:46:09.341Z","trace_propagation_headers":{"sentry-trace":"c3363060204f4669b7cc50d700349846-d4e21f6012c240ed","baggage":"sentry-trace_id=c3363060204f4669b7cc50d700349846,sentry-release=Unknown"},"correlation_id":"01M16W7R5X03E0YY4H97G573W6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b18ce768c4f0c33066362e1446f2856c623d5691fb51a5bbd9c097b1ca97cc7","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:09.347Z","job_size_bytes":467,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-8846151e2a9caf2754cb8316: start","job_status":"start","queue_duration_s":2.289862,"scheduling_latency_s":2.289897}2151gitlab # [ 424.891585] nixbot[3547]: INFO: ::ffff:127.0.0.1:46620 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK2152gitlab # [ 424.893645] gitaly[896]: time="2026-08-29T13:46:11.680Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M16W7R5X03E0YY4H97G573W6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-29T13:46:41.578" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:46:11.679" grpc.time_ms=0.914 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2153gitlab # [ 424.906015] gitaly[896]: time="2026-08-29T13:46:11.698Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M16W7R5X03E0YY4H97G573W6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-29T13:46:21.093" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-29T13:46:11.684" grpc.time_ms=13.771 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2154gitlab # [ 425.052611] gitaly[896]: time="2026-08-29T13:46:11.856Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M16W7R5X03E0YY4H97G573W6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-29T13:46:41.754" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:46:11.855" grpc.time_ms=1.224 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2155gitlab # [ 425.089308] gitaly[896]: time="2026-08-29T13:46:11.868Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=183 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M16W7R5X03E0YY4H97G573W6 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-29T13:46:41.763" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:46:11.864" grpc.time_ms=3.979 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2156gitlab # [ 425.183936] gitaly[896]: time="2026-08-29T13:46:11.988Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M16W7R5X03E0YY4H97G573W6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-29T13:46:21.162" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-29T13:46:11.972" grpc.time_ms=15.903 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2157gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'2158gitlab # [ 425.889744] nixbot[3547]: INFO: ::ffff:127.0.0.1:46630 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK2159gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)2160gitlab # [ 425.977723] gitaly[896]: time="2026-08-29T13:46:12.782Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=881 command.oublock=0 command.real_time_ms=22 command.spawn_token_fork_ms=2 command.system_time_ms=19 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M16W7R5X03E0YY4H97G573W6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-29T13:46:42.655" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:46:12.756" grpc.time_ms=26.198 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2161gitlab # [ 426.008636] gitaly[896]: time="2026-08-29T13:46:12.813Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=3 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M16W7R5X03E0YY4H97G573W6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-29T13:46:42.688" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:46:12.788" grpc.time_ms=24.714 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2162gitlab # [ 426.073999] sidekiq-cluster[3497]: {"severity":"WARN","time":"2026-08-29T13:46:12.877Z","class":"CreatePipelineWorker","correlation_id":"01M16W7R5X03E0YY4H97G573W6","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"00271b64e0dc3f3d9dbebae68f634a97c7630b09","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"00271b64e0dc3f3d9dbebae68f634a97c7630b09","ref":"refs/heads/master"},"retry":0}2163gitlab # [ 426.091240] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:12.895Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"8846151e2a9caf2754cb8316","created_at":"2026-08-29T13:46:09.341Z","trace_propagation_headers":{"sentry-trace":"c3363060204f4669b7cc50d700349846-d4e21f6012c240ed","baggage":"sentry-trace_id=c3363060204f4669b7cc50d700349846,sentry-release=Unknown"},"correlation_id":"01M16W7R5X03E0YY4H97G573W6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b18ce768c4f0c33066362e1446f2856c623d5691fb51a5bbd9c097b1ca97cc7","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:09.347Z","job_size_bytes":467,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-8846151e2a9caf2754cb8316: done: 1.258096 sec","job_status":"done","queue_duration_s":2.289862,"scheduling_latency_s":2.289897,"gitaly_calls":7,"gitaly_duration_s":0.111658,"redis_calls":51,"redis_duration_s":0.01578,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.00136,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.006923,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002241,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003397,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001859,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.045,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.038,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.065414,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00071948,"duration_s":1.258096,"completed_at":"2026-08-29T13:46:12.894Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.08395,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2164gitlab # [ 426.165634] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:12.898Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"a8fbd783-3443-48cc-96ab-b2ab4c99d0a3\"}"],"class":"WebHookWorker","jid":"198cabc4b9613c1583e432c0","created_at":"2026-08-29T13:46:09.493Z","trace_propagation_headers":{"sentry-trace":"c3363060204f4669b7cc50d700349846-d4e21f6012c240ed","baggage":"sentry-trace_id=c3363060204f4669b7cc50d700349846,sentry-release=Unknown"},"correlation_id":"01M16W7R5X03E0YY4H97G573W6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b91c05c3d053b0bd776a64c8607ee7f6b347b0e3278292251cb79dcca7ab980","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:09.499Z","job_size_bytes":1751,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-198cabc4b9613c1583e432c0: start","job_status":"start","queue_duration_s":3.399767,"scheduling_latency_s":3.39981}2165gitlab # [ 426.311036] nixbot[3547]: INFO: ::ffff:127.0.0.1:46634 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2166gitlab # [ 426.352720] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:13.156Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"a8fbd783-3443-48cc-96ab-b2ab4c99d0a3\"}"],"class":"WebHookWorker","jid":"198cabc4b9613c1583e432c0","created_at":"2026-08-29T13:46:09.493Z","trace_propagation_headers":{"sentry-trace":"c3363060204f4669b7cc50d700349846-d4e21f6012c240ed","baggage":"sentry-trace_id=c3363060204f4669b7cc50d700349846,sentry-release=Unknown"},"correlation_id":"01M16W7R5X03E0YY4H97G573W6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b91c05c3d053b0bd776a64c8607ee7f6b347b0e3278292251cb79dcca7ab980","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:09.499Z","job_size_bytes":1751,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-198cabc4b9613c1583e432c0: done: 0.257425 sec","job_status":"done","queue_duration_s":3.399767,"scheduling_latency_s":3.39981,"redis_calls":19,"redis_duration_s":0.007686,"redis_read_bytes":32,"redis_write_bytes":5367,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001965,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000737,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003332,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001652,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.09046409999996285,"cpu_s":0.141498,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00091424,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.257425,"completed_at":"2026-08-29T13:46:13.156Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005756,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2167gitlab # [ 426.476995] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:13.159Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"b9da46406eceef2ccf0c8276","created_at":"2026-08-29T13:46:09.655Z","trace_propagation_headers":{"sentry-trace":"5233baf4d15644ecacc820dd114971ef-167c71901fd241f0","baggage":"sentry-trace_id=5233baf4d15644ecacc820dd114971ef,sentry-release=Unknown"},"correlation_id":"01M16W7YEZ388PJ3RN04JJE16S","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"84a274306a1daa03e6dc7787","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:09.660Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-b9da46406eceef2ccf0c8276: start","job_status":"start","queue_duration_s":3.498661,"scheduling_latency_s":3.4987}2168gitlab # [ 426.502140] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:13.263Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"b9da46406eceef2ccf0c8276","created_at":"2026-08-29T13:46:09.655Z","trace_propagation_headers":{"sentry-trace":"5233baf4d15644ecacc820dd114971ef-167c71901fd241f0","baggage":"sentry-trace_id=5233baf4d15644ecacc820dd114971ef,sentry-release=Unknown"},"correlation_id":"01M16W7YEZ388PJ3RN04JJE16S","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"84a274306a1daa03e6dc7787","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:09.660Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-b9da46406eceef2ccf0c8276: done: 0.103616 sec","job_status":"done","queue_duration_s":3.498661,"scheduling_latency_s":3.4987,"gitaly_calls":1,"gitaly_duration_s":0.032896,"redis_calls":12,"redis_duration_s":0.005625,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002236,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001142,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002247,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.013,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.013,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.05379,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.06513062,"duration_s":0.103616,"completed_at":"2026-08-29T13:46:13.263Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010163,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2169gitlab # [ 426.552038] gitaly[896]: time="2026-08-29T13:46:13.225Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M16W7YEZ388PJ3RN04JJE16S diskcache=ed845556-9edc-4633-9c43-de12f68159f3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-29T19:46:13.195" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:46:13.196" pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2170gitlab # [ 426.561795] gitaly[896]: time="2026-08-29T13:46:13.225Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=289 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M16W7YEZ388PJ3RN04JJE16S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-29T19:46:13.195" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:46:13.196" grpc.time_ms=29.041 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2171gitlab # [ 426.574961] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:13.266Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"69e5915066ac29fb624dafe2","created_at":"2026-08-29T13:46:09.864Z","trace_propagation_headers":{"sentry-trace":"5233baf4d15644ecacc820dd114971ef-167c71901fd241f0","baggage":"sentry-trace_id=5233baf4d15644ecacc820dd114971ef,sentry-release=Unknown"},"correlation_id":"01M16W7YEZ388PJ3RN04JJE16S","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:67fa5f633b63e3fd3f4ba8b16632b77405bc85e3f44d978667bf95f7fd7668eb","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:09.867Z","job_size_bytes":467,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-69e5915066ac29fb624dafe2: start","job_status":"start","queue_duration_s":3.398314,"scheduling_latency_s":3.39835}2172gitlab # [ 426.592153] gitaly[896]: time="2026-08-29T13:46:13.307Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M16W7YEZ388PJ3RN04JJE16S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-29T13:46:43.205" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:46:13.306" grpc.time_ms=1.362 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2173gitlab # [ 426.604349] gitaly[896]: time="2026-08-29T13:46:13.323Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M16W7YEZ388PJ3RN04JJE16S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-29T13:46:23.000" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-29T13:46:13.311" grpc.time_ms=11.862 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2174gitlab # [ 426.617285] gitaly[896]: time="2026-08-29T13:46:13.378Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M16W7YEZ388PJ3RN04JJE16S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-29T13:46:43.275" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:46:13.376" grpc.time_ms=1.443 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2175gitlab # [ 426.630888] gitaly[896]: time="2026-08-29T13:46:13.388Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=164 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M16W7YEZ388PJ3RN04JJE16S error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-29T13:46:43.283" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:46:13.383" grpc.time_ms=4.701 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2176gitlab # [ 426.647010] gitaly[896]: time="2026-08-29T13:46:13.439Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M16W7YEZ388PJ3RN04JJE16S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-29T13:46:23.117" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-29T13:46:13.427" grpc.time_ms=11.478 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2177gitlab # [ 426.686211] gitaly[896]: time="2026-08-29T13:46:13.491Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M16WAN9C9JW2QPPKMRG23JY9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-29T13:46:13.477" grpc.time_ms=13.151 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc2178gitlab # [ 426.701800] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:46:13 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 3272179gitlab # [ 426.770042] gitaly[896]: time="2026-08-29T13:46:13.574Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M16WANKNTWA1D8RK4HKRNKG2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-29T13:46:13.557" pid=896 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2180gitlab # [ 426.792101] gitaly[896]: time="2026-08-29T13:46:13.574Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M16WANKNTWA1D8RK4HKRNKG2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-29T13:46:13.557" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc2181gitlab # [ 426.813554] gitlab-workhorse[822]: time="2026-08-29T13:46:13Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672182gitlab # [ 426.816144] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:46:13 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 842183gitlab # [ 426.818681] gitaly[896]: time="2026-08-29T13:46:13.577Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M16WANKNTWA1D8RK4HKRNKG2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-29T13:46:13.557" grpc.time_ms=19.874 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc2184gitlab # [ 426.838595] nixbot[3547]: {"ts": "2026-08-29T13:46:13.621Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}2185gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'2186gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.07 seconds)2187gitlab # [ 426.959044] nixbot[3547]: INFO: ::ffff:127.0.0.1:46640 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK2188gitlab # [ 426.974747] gitaly[896]: time="2026-08-29T13:46:13.779Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M16WANR7VK6295REW4KTYRM6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-29T13:46:43.177" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:46:13.778" grpc.time_ms=0.917 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2189gitlab # [ 427.073732] gitaly[896]: time="2026-08-29T13:46:13.878Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M16WANR7VK6295REW4KTYRM6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-29T13:46:23.210" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-29T13:46:13.861" grpc.time_ms=16.556 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2190gitlab # [ 427.209679] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:46:14 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/00271b64e0dc3f3d9dbebae68f634a97c7630b09 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 3742191gitlab # [ 427.217916] nixbot[3547]: {"ts": "2026-08-29T13:46:14.016Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/00271b64e0dc3f3d9dbebae68f634a97c7630b09 \"HTTP/1.1 201 Created\""}2192gitlab # [ 427.298959] gitaly[896]: time="2026-08-29T13:46:14.103Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=881 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M16W7YEZ388PJ3RN04JJE16S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-29T13:46:44.080" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:46:14.080" grpc.time_ms=22.973 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2193gitlab # [ 427.340206] gitaly[896]: time="2026-08-29T13:46:14.129Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M16W7YEZ388PJ3RN04JJE16S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-29T13:46:44.006" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:46:14.106" grpc.time_ms=23.179 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2194gitlab # [ 427.363521] gitaly[896]: time="2026-08-29T13:46:14.160Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M16WAP49AYSW667FG9BP7X65 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-29T13:46:44.059" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:46:14.159" grpc.time_ms=0.912 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2195gitlab # [ 427.383324] sidekiq-cluster[3497]: {"severity":"WARN","time":"2026-08-29T13:46:14.149Z","class":"CreatePipelineWorker","correlation_id":"01M16W7YEZ388PJ3RN04JJE16S","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"00271b64e0dc3f3d9dbebae68f634a97c7630b09","after":"a868350d45cf235a21d84a90a239221281f6ba62","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"a868350d45cf235a21d84a90a239221281f6ba62","ref":"refs/heads/master"},"retry":0}2196gitlab # [ 427.394232] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:14.156Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"69e5915066ac29fb624dafe2","created_at":"2026-08-29T13:46:09.864Z","trace_propagation_headers":{"sentry-trace":"5233baf4d15644ecacc820dd114971ef-167c71901fd241f0","baggage":"sentry-trace_id=5233baf4d15644ecacc820dd114971ef,sentry-release=Unknown"},"correlation_id":"01M16W7YEZ388PJ3RN04JJE16S","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:67fa5f633b63e3fd3f4ba8b16632b77405bc85e3f44d978667bf95f7fd7668eb","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:09.867Z","job_size_bytes":467,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-69e5915066ac29fb624dafe2: done: 0.89069 sec","job_status":"done","queue_duration_s":3.398314,"scheduling_latency_s":3.39835,"gitaly_calls":7,"gitaly_duration_s":0.099161,"redis_calls":33,"redis_duration_s":0.007834,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000923,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001809,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003732,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00137,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.033,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.762687,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.89069,"completed_at":"2026-08-29T13:46:14.156Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.032611,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2197gitlab # [ 427.459377] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:14.159Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"d055ebba-d585-46db-9f0e-862c9eef0aa4\"}"],"class":"WebHookWorker","jid":"7c21d85e4fa20fc509815091","created_at":"2026-08-29T13:46:09.897Z","trace_propagation_headers":{"sentry-trace":"5233baf4d15644ecacc820dd114971ef-167c71901fd241f0","baggage":"sentry-trace_id=5233baf4d15644ecacc820dd114971ef,sentry-release=Unknown"},"correlation_id":"01M16W7YEZ388PJ3RN04JJE16S","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:87cee2e35c28a6954db6c6877eb6f161fadd16b34ac5856403ce2daa5b7b263a","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:09.902Z","job_size_bytes":1749,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-7c21d85e4fa20fc509815091: start","job_status":"start","queue_duration_s":4.256637,"scheduling_latency_s":4.257078}2198gitlab # [ 427.478738] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:14.216Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"d055ebba-d585-46db-9f0e-862c9eef0aa4\"}"],"class":"WebHookWorker","jid":"7c21d85e4fa20fc509815091","created_at":"2026-08-29T13:46:09.897Z","trace_propagation_headers":{"sentry-trace":"5233baf4d15644ecacc820dd114971ef-167c71901fd241f0","baggage":"sentry-trace_id=5233baf4d15644ecacc820dd114971ef,sentry-release=Unknown"},"correlation_id":"01M16W7YEZ388PJ3RN04JJE16S","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:87cee2e35c28a6954db6c6877eb6f161fadd16b34ac5856403ce2daa5b7b263a","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:09.902Z","job_size_bytes":1749,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-7c21d85e4fa20fc509815091: done: 0.057317 sec","job_status":"done","queue_duration_s":4.256637,"scheduling_latency_s":4.257078,"redis_calls":14,"redis_duration_s":0.003339,"redis_read_bytes":26,"redis_write_bytes":4685,"redis_queues_calls":2,"redis_queues_duration_s":0.000414,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001757,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001168,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.010591980000015155,"cpu_s":0.03239,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.057317,"completed_at":"2026-08-29T13:46:14.216Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006095,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2199gitlab # [ 427.527181] gitaly[896]: time="2026-08-29T13:46:14.249Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M16WAP49AYSW667FG9BP7X65 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-29T13:46:24.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-29T13:46:14.239" grpc.time_ms=10.164 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2200gitlab # [ 427.541294] nixbot[3547]: INFO: ::ffff:127.0.0.1:46654 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2201gitlab # [ 427.542524] nixbot[3547]: {"ts": "2026-08-29T13:46:14.323Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/00271b64e0dc3f3d9dbebae68f634a97c7630b09 \"HTTP/1.1 201 Created\""}2202gitlab # [ 427.545352] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:14.218Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"c0c6550577cec034b6cf6380","created_at":"2026-08-29T13:46:10.685Z","trace_propagation_headers":{"sentry-trace":"7b85cacc0dde4852a7b61ab82d1509f7-76b2dd2c20574098","baggage":"sentry-trace_id=7b85cacc0dde4852a7b61ab82d1509f7,sentry-release=Unknown"},"correlation_id":"01M16W7Z7SMMFVH6GZNDCJBA2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:10.696Z","job_size_bytes":23,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-c0c6550577cec034b6cf6380: start","job_status":"start","queue_duration_s":3.522006,"scheduling_latency_s":3.522033}2203gitlab # [ 427.562228] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:14.325Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"c0c6550577cec034b6cf6380","created_at":"2026-08-29T13:46:10.685Z","trace_propagation_headers":{"sentry-trace":"7b85cacc0dde4852a7b61ab82d1509f7-76b2dd2c20574098","baggage":"sentry-trace_id=7b85cacc0dde4852a7b61ab82d1509f7,sentry-release=Unknown"},"correlation_id":"01M16W7Z7SMMFVH6GZNDCJBA2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:10.696Z","job_size_bytes":23,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-c0c6550577cec034b6cf6380: done: 0.107206 sec","job_status":"done","queue_duration_s":3.522006,"scheduling_latency_s":3.522033,"redis_calls":10,"redis_duration_s":0.002015,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000406,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001233,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000376,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.070517,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002468,"duration_s":0.107206,"completed_at":"2026-08-29T13:46:14.325Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.025208,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2204gitlab # [ 427.606810] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:46:14 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/00271b64e0dc3f3d9dbebae68f634a97c7630b09 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2962205gitlab # [ 427.609418] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:46:14 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1032206gitlab # [ 427.611795] gitaly[896]: time="2026-08-29T13:46:14.366Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M16WAPBRTRMGH8QGV3BMEB80 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-29T13:46:14.357" grpc.time_ms=9.8 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc2207gitlab # [ 427.624967] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:14.327Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"ef6cd6c5ff04b7747fbd9577","created_at":"2026-08-29T13:46:10.906Z","trace_propagation_headers":{"sentry-trace":"7b85cacc0dde4852a7b61ab82d1509f7-76b2dd2c20574098","baggage":"sentry-trace_id=7b85cacc0dde4852a7b61ab82d1509f7,sentry-release=Unknown"},"correlation_id":"01M16W7Z7SMMFVH6GZNDCJBA2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:10.917Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-ef6cd6c5ff04b7747fbd9577: start","job_status":"start","queue_duration_s":3.410024,"scheduling_latency_s":3.410044}2208gitlab # [ 427.642813] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:14.362Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"ef6cd6c5ff04b7747fbd9577","created_at":"2026-08-29T13:46:10.906Z","trace_propagation_headers":{"sentry-trace":"7b85cacc0dde4852a7b61ab82d1509f7-76b2dd2c20574098","baggage":"sentry-trace_id=7b85cacc0dde4852a7b61ab82d1509f7,sentry-release=Unknown"},"correlation_id":"01M16W7Z7SMMFVH6GZNDCJBA2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:10.917Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-ef6cd6c5ff04b7747fbd9577: done: 0.034956 sec","job_status":"done","queue_duration_s":3.410024,"scheduling_latency_s":3.410044,"redis_calls":10,"redis_duration_s":0.001426,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000292,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000834,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0003,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024369,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00029314,"duration_s":0.034956,"completed_at":"2026-08-29T13:46:14.362Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004197,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2209gitlab # [ 427.693974] gitaly[896]: time="2026-08-29T13:46:14.418Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M16WAPDW51ZESJJW0J9K037J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-29T13:46:44.316" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:46:14.416" grpc.time_ms=1.642 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2210gitlab # [ 427.706954] gitaly[896]: time="2026-08-29T13:46:14.436Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M16WAPF1288H8CAZXDZRA1VE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-29T13:46:14.423" pid=896 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2211gitlab # [ 427.717698] gitlab-workhorse[822]: time="2026-08-29T13:46:14Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672212gitlab # [ 427.719517] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:46:14 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 672213gitlab # [ 427.721552] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:14.363Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"282610276aa6f422b1cfe6a8","created_at":"2026-08-29T13:46:10.944Z","trace_propagation_headers":{"sentry-trace":"7b85cacc0dde4852a7b61ab82d1509f7-76b2dd2c20574098","baggage":"sentry-trace_id=7b85cacc0dde4852a7b61ab82d1509f7,sentry-release=Unknown"},"correlation_id":"01M16W7Z7SMMFVH6GZNDCJBA2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:10.957Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-282610276aa6f422b1cfe6a8: start","job_status":"start","queue_duration_s":3.406536,"scheduling_latency_s":3.406555}2214gitlab # [ 427.737213] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:14.405Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"282610276aa6f422b1cfe6a8","created_at":"2026-08-29T13:46:10.944Z","trace_propagation_headers":{"sentry-trace":"7b85cacc0dde4852a7b61ab82d1509f7-76b2dd2c20574098","baggage":"sentry-trace_id=7b85cacc0dde4852a7b61ab82d1509f7,sentry-release=Unknown"},"correlation_id":"01M16W7Z7SMMFVH6GZNDCJBA2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:10.957Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-282610276aa6f422b1cfe6a8: done: 0.041807 sec","job_status":"done","queue_duration_s":3.406536,"scheduling_latency_s":3.406555,"redis_calls":10,"redis_duration_s":0.004872,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000519,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003871,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000482,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026713,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00108468,"duration_s":0.041807,"completed_at":"2026-08-29T13:46:14.405Z","load_balancing_strategy":"primary","db_duration_s":0.004971,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2215gitlab # [ 427.780954] gitaly[896]: time="2026-08-29T13:46:14.436Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=6 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M16WAPF1288H8CAZXDZRA1VE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-29T13:46:14.423" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc2216gitlab # [ 427.795362] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:14.407Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"7221f949b62fdc5f02cba2da","created_at":"2026-08-29T13:46:10.987Z","trace_propagation_headers":{"sentry-trace":"7b85cacc0dde4852a7b61ab82d1509f7-76b2dd2c20574098","baggage":"sentry-trace_id=7b85cacc0dde4852a7b61ab82d1509f7,sentry-release=Unknown"},"correlation_id":"01M16W7Z7SMMFVH6GZNDCJBA2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:10.997Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-7221f949b62fdc5f02cba2da: start","job_status":"start","queue_duration_s":3.40997,"scheduling_latency_s":3.409989}2217gitlab # [ 427.811077] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:14.453Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"7221f949b62fdc5f02cba2da","created_at":"2026-08-29T13:46:10.987Z","trace_propagation_headers":{"sentry-trace":"7b85cacc0dde4852a7b61ab82d1509f7-76b2dd2c20574098","baggage":"sentry-trace_id=7b85cacc0dde4852a7b61ab82d1509f7,sentry-release=Unknown"},"correlation_id":"01M16W7Z7SMMFVH6GZNDCJBA2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:10.997Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-7221f949b62fdc5f02cba2da: done: 0.046321 sec","job_status":"done","queue_duration_s":3.40997,"scheduling_latency_s":3.409989,"redis_calls":13,"redis_duration_s":0.008764000000000001,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001433,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005027,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000401,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001903,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027751,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0034583,"duration_s":0.046321,"completed_at":"2026-08-29T13:46:14.453Z","load_balancing_strategy":"primary","db_duration_s":0.004755,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2218gitlab # [ 427.858517] gitaly[896]: time="2026-08-29T13:46:14.436Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=6 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M16WAPF1288H8CAZXDZRA1VE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-29T13:46:14.423" grpc.time_ms=13.418 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc2219gitlab # [ 427.873348] nixbot[3547]: {"ts": "2026-08-29T13:46:14.614Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/00271b64e0dc3f3d9dbebae68f634a97c7630b09 \"HTTP/1.1 201 Created\""}2220gitlab # [ 427.876093] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:14.455Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"ac4b7038eb70e4eac37a037c","created_at":"2026-08-29T13:46:10.998Z","trace_propagation_headers":{"sentry-trace":"7b85cacc0dde4852a7b61ab82d1509f7-76b2dd2c20574098","baggage":"sentry-trace_id=7b85cacc0dde4852a7b61ab82d1509f7,sentry-release=Unknown"},"correlation_id":"01M16W7Z7SMMFVH6GZNDCJBA2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:11.009Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-ac4b7038eb70e4eac37a037c: start","job_status":"start","queue_duration_s":3.445619,"scheduling_latency_s":3.445637}2221gitlab # [ 427.892675] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:14.502Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"ac4b7038eb70e4eac37a037c","created_at":"2026-08-29T13:46:10.998Z","trace_propagation_headers":{"sentry-trace":"7b85cacc0dde4852a7b61ab82d1509f7-76b2dd2c20574098","baggage":"sentry-trace_id=7b85cacc0dde4852a7b61ab82d1509f7,sentry-release=Unknown"},"correlation_id":"01M16W7Z7SMMFVH6GZNDCJBA2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:11.009Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-ac4b7038eb70e4eac37a037c: done: 0.047009 sec","job_status":"done","queue_duration_s":3.445619,"scheduling_latency_s":3.445637,"redis_calls":10,"redis_duration_s":0.009840999999999999,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000435,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006913,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002493,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027463,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00051008,"duration_s":0.047009,"completed_at":"2026-08-29T13:46:14.502Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004154,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2222gitlab # [ 427.937488] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:46:14 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/00271b64e0dc3f3d9dbebae68f634a97c7630b09 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2792223gitlab # [ 427.939945] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:46:14 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1302224gitlab # [ 427.942218] gitlab-workhorse[822]: time="2026-08-29T13:46:14Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672225gitlab # [ 427.944034] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:46:14 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 762226gitlab # [ 427.945883] gitaly[896]: time="2026-08-29T13:46:14.472Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=4 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M16WAPDW51ZESJJW0J9K037J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-29T13:46:24.233" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-29T13:46:14.463" grpc.time_ms=8.18 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2227gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'2228gitlab # [ 427.959497] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:14.503Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"390065c4697f3c7e55607498","created_at":"2026-08-29T13:46:11.010Z","trace_propagation_headers":{"sentry-trace":"7b85cacc0dde4852a7b61ab82d1509f7-76b2dd2c20574098","baggage":"sentry-trace_id=7b85cacc0dde4852a7b61ab82d1509f7,sentry-release=Unknown"},"correlation_id":"01M16W7Z7SMMFVH6GZNDCJBA2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:11.020Z","job_size_bytes":19,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-390065c4697f3c7e55607498: start","job_status":"start","queue_duration_s":3.483689,"scheduling_latency_s":3.483708}2229gitlab # [ 427.975035] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:14.547Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"390065c4697f3c7e55607498","created_at":"2026-08-29T13:46:11.010Z","trace_propagation_headers":{"sentry-trace":"7b85cacc0dde4852a7b61ab82d1509f7-76b2dd2c20574098","baggage":"sentry-trace_id=7b85cacc0dde4852a7b61ab82d1509f7,sentry-release=Unknown"},"correlation_id":"01M16W7Z7SMMFVH6GZNDCJBA2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:11.020Z","job_size_bytes":19,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-390065c4697f3c7e55607498: done: 0.044172 sec","job_status":"done","queue_duration_s":3.483689,"scheduling_latency_s":3.483708,"redis_calls":11,"redis_duration_s":0.0052959999999999995,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000421,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003064,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001811,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025496,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00148524,"duration_s":0.044172,"completed_at":"2026-08-29T13:46:14.547Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005743,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2230gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.06 seconds)2231gitlab # [ 428.018524] gitaly[896]: time="2026-08-29T13:46:14.629Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=4 command.system_time_ms=0 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01M16WAPK43X8MHMXQ0QERCEB8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-29T13:46:14.617" grpc.time_ms=12.237 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc2232gitlab # [ 428.032115] gitaly[896]: time="2026-08-29T13:46:14.708Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M16WAPQ8Y2KGHPZEXNKC9RXW grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-29T13:46:14.699" pid=896 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2233gitlab # [ 428.042003] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:14.550Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"73a8c68a5cfefcb982674385","created_at":"2026-08-29T13:46:11.024Z","trace_propagation_headers":{"sentry-trace":"7b85cacc0dde4852a7b61ab82d1509f7-76b2dd2c20574098","baggage":"sentry-trace_id=7b85cacc0dde4852a7b61ab82d1509f7,sentry-release=Unknown"},"correlation_id":"01M16W7Z7SMMFVH6GZNDCJBA2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:11.033Z","job_size_bytes":66,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-73a8c68a5cfefcb982674385: start","job_status":"start","queue_duration_s":3.516469,"scheduling_latency_s":3.51649}2234gitlab # [ 428.060756] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:14.590Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"73a8c68a5cfefcb982674385","created_at":"2026-08-29T13:46:11.024Z","trace_propagation_headers":{"sentry-trace":"7b85cacc0dde4852a7b61ab82d1509f7-76b2dd2c20574098","baggage":"sentry-trace_id=7b85cacc0dde4852a7b61ab82d1509f7,sentry-release=Unknown"},"correlation_id":"01M16W7Z7SMMFVH6GZNDCJBA2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:11.033Z","job_size_bytes":66,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-73a8c68a5cfefcb982674385: done: 0.040012 sec","job_status":"done","queue_duration_s":3.516469,"scheduling_latency_s":3.51649,"redis_calls":10,"redis_duration_s":0.003062,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000349,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001501,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001212,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023082,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034418,"duration_s":0.040012,"completed_at":"2026-08-29T13:46:14.590Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005381,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2235gitlab # [ 428.106517] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:46:14 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 862236gitlab # [ 428.108705] gitaly[896]: time="2026-08-29T13:46:14.708Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M16WAPQ8Y2KGHPZEXNKC9RXW grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-29T13:46:14.699" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc2237gitlab # [ 428.121804] nixbot[3547]: INFO: ::ffff:127.0.0.1:46668 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK2238gitlab # [ 428.123716] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:14.593Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"a680cec2c004197c24877653","created_at":"2026-08-29T13:46:11.035Z","trace_propagation_headers":{"sentry-trace":"7b85cacc0dde4852a7b61ab82d1509f7-76b2dd2c20574098","baggage":"sentry-trace_id=7b85cacc0dde4852a7b61ab82d1509f7,sentry-release=Unknown"},"correlation_id":"01M16W7Z7SMMFVH6GZNDCJBA2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:11.042Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-a680cec2c004197c24877653: start","job_status":"start","queue_duration_s":3.551763,"scheduling_latency_s":3.551783}2239gitlab # [ 428.141213] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:14.640Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"a680cec2c004197c24877653","created_at":"2026-08-29T13:46:11.035Z","trace_propagation_headers":{"sentry-trace":"7b85cacc0dde4852a7b61ab82d1509f7-76b2dd2c20574098","baggage":"sentry-trace_id=7b85cacc0dde4852a7b61ab82d1509f7,sentry-release=Unknown"},"correlation_id":"01M16W7Z7SMMFVH6GZNDCJBA2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:11.042Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-a680cec2c004197c24877653: done: 0.047109 sec","job_status":"done","queue_duration_s":3.551763,"scheduling_latency_s":3.551783,"redis_calls":10,"redis_duration_s":0.0022730000000000003,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000299,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001677,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000297,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031532,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024686,"duration_s":0.047109,"completed_at":"2026-08-29T13:46:14.640Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008807,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2240gitlab # [ 428.185799] gitaly[896]: time="2026-08-29T13:46:14.708Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M16WAPQ8Y2KGHPZEXNKC9RXW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-29T13:46:14.699" grpc.time_ms=8.538 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc2241gitlab # [ 428.200264] gitlab-workhorse[822]: time="2026-08-29T13:46:14Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2162242gitlab # [ 428.202091] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:46:14 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 872243gitlab # [ 428.203905] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:14.642Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"37e59750441b365d73fcaf36","created_at":"2026-08-29T13:46:11.051Z","trace_propagation_headers":{"sentry-trace":"7b85cacc0dde4852a7b61ab82d1509f7-76b2dd2c20574098","baggage":"sentry-trace_id=7b85cacc0dde4852a7b61ab82d1509f7,sentry-release=Unknown"},"correlation_id":"01M16W7Z7SMMFVH6GZNDCJBA2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:11.058Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-37e59750441b365d73fcaf36: start","job_status":"start","queue_duration_s":3.583725,"scheduling_latency_s":3.583748}2244gitlab # [ 428.220793] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:14.683Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"37e59750441b365d73fcaf36","created_at":"2026-08-29T13:46:11.051Z","trace_propagation_headers":{"sentry-trace":"7b85cacc0dde4852a7b61ab82d1509f7-76b2dd2c20574098","baggage":"sentry-trace_id=7b85cacc0dde4852a7b61ab82d1509f7,sentry-release=Unknown"},"correlation_id":"01M16W7Z7SMMFVH6GZNDCJBA2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:11.058Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-37e59750441b365d73fcaf36: done: 0.040859 sec","job_status":"done","queue_duration_s":3.583725,"scheduling_latency_s":3.583748,"redis_calls":10,"redis_duration_s":0.001422,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000324,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000799,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000299,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023191,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000239,"duration_s":0.040859,"completed_at":"2026-08-29T13:46:14.683Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012133,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2245gitlab # [ 428.266596] gitaly[896]: time="2026-08-29T13:46:14.839Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=4 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M16WAPV1HJC4VC43PHBQFF7S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-29T13:46:14.827" grpc.time_ms=11.952 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc2246gitlab # [ 428.280213] gitaly[896]: time="2026-08-29T13:46:14.928Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M16WAPXTD9SPMY7C4W097WMB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-29T13:46:14.907" pid=896 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc2247gitlab # [ 428.290378] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:14.685Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"278f4c16c18dfc50fedba821","created_at":"2026-08-29T13:46:11.059Z","trace_propagation_headers":{"sentry-trace":"7b85cacc0dde4852a7b61ab82d1509f7-76b2dd2c20574098","baggage":"sentry-trace_id=7b85cacc0dde4852a7b61ab82d1509f7,sentry-release=Unknown"},"correlation_id":"01M16W7Z7SMMFVH6GZNDCJBA2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:11.065Z","job_size_bytes":6,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-278f4c16c18dfc50fedba821: start","job_status":"start","queue_duration_s":3.619748,"scheduling_latency_s":3.619766}2248gitlab # [ 428.306337] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:14.711Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"278f4c16c18dfc50fedba821","created_at":"2026-08-29T13:46:11.059Z","trace_propagation_headers":{"sentry-trace":"7b85cacc0dde4852a7b61ab82d1509f7-76b2dd2c20574098","baggage":"sentry-trace_id=7b85cacc0dde4852a7b61ab82d1509f7,sentry-release=Unknown"},"correlation_id":"01M16W7Z7SMMFVH6GZNDCJBA2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:11.065Z","job_size_bytes":6,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-278f4c16c18dfc50fedba821: done: 0.025731 sec","job_status":"done","queue_duration_s":3.619748,"scheduling_latency_s":3.619766,"redis_calls":10,"redis_duration_s":0.001851,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000293,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000933,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000625,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0167,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032348,"duration_s":0.025731,"completed_at":"2026-08-29T13:46:14.711Z","load_balancing_strategy":"primary","db_duration_s":0.002698,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2249gitlab # [ 428.350971] gitaly[896]: time="2026-08-29T13:46:14.928Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1102 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M16WAPXTD9SPMY7C4W097WMB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-29T13:46:14.907" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc2250gitlab # [ 428.364735] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:14.713Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"877e7b2ad09df501ec1bfb16","created_at":"2026-08-29T13:46:11.066Z","trace_propagation_headers":{"sentry-trace":"7b85cacc0dde4852a7b61ab82d1509f7-76b2dd2c20574098","baggage":"sentry-trace_id=7b85cacc0dde4852a7b61ab82d1509f7,sentry-release=Unknown"},"correlation_id":"01M16W7Z7SMMFVH6GZNDCJBA2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:11.071Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-877e7b2ad09df501ec1bfb16: start","job_status":"start","queue_duration_s":3.641395,"scheduling_latency_s":3.641413}2251gitlab # [ 428.380335] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:14.766Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"877e7b2ad09df501ec1bfb16","created_at":"2026-08-29T13:46:11.066Z","trace_propagation_headers":{"sentry-trace":"7b85cacc0dde4852a7b61ab82d1509f7-76b2dd2c20574098","baggage":"sentry-trace_id=7b85cacc0dde4852a7b61ab82d1509f7,sentry-release=Unknown"},"correlation_id":"01M16W7Z7SMMFVH6GZNDCJBA2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:11.071Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-877e7b2ad09df501ec1bfb16: done: 0.05375 sec","job_status":"done","queue_duration_s":3.641395,"scheduling_latency_s":3.641413,"redis_calls":10,"redis_duration_s":0.00627,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00042,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005485,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000365,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035399,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026208,"duration_s":0.05375,"completed_at":"2026-08-29T13:46:14.766Z","load_balancing_strategy":"primary","db_duration_s":0.009138,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2252gitlab # [ 428.424075] gitaly[896]: time="2026-08-29T13:46:14.931Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1102 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M16WAPXTD9SPMY7C4W097WMB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-29T13:46:14.907" grpc.time_ms=21.609 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc2253gitlab # [ 428.439437] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:14.768Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"6bcfff682e4aad9caf3e8530","created_at":"2026-08-29T13:46:11.080Z","trace_propagation_headers":{"sentry-trace":"7b85cacc0dde4852a7b61ab82d1509f7-76b2dd2c20574098","baggage":"sentry-trace_id=7b85cacc0dde4852a7b61ab82d1509f7,sentry-release=Unknown"},"correlation_id":"01M16W7Z7SMMFVH6GZNDCJBA2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:11.086Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-6bcfff682e4aad9caf3e8530: start","job_status":"start","queue_duration_s":3.68128,"scheduling_latency_s":3.681296}2254gitlab # [ 428.455811] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:14.836Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"6bcfff682e4aad9caf3e8530","created_at":"2026-08-29T13:46:11.080Z","trace_propagation_headers":{"sentry-trace":"7b85cacc0dde4852a7b61ab82d1509f7-76b2dd2c20574098","baggage":"sentry-trace_id=7b85cacc0dde4852a7b61ab82d1509f7,sentry-release=Unknown"},"correlation_id":"01M16W7Z7SMMFVH6GZNDCJBA2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:11.086Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-6bcfff682e4aad9caf3e8530: done: 0.068421 sec","job_status":"done","queue_duration_s":3.68128,"scheduling_latency_s":3.681296,"redis_calls":14,"redis_duration_s":0.002711,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.0004,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001362,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000949,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046136,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00028272,"duration_s":0.068421,"completed_at":"2026-08-29T13:46:14.836Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013893,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2255gitlab # [ 428.502418] gitaly[896]: time="2026-08-29T13:46:15.032Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M16WAQ1SB3CB1X16BYHDCNWX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-29T13:46:45.030" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:46:15.030" grpc.time_ms=1.783 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2256gitlab # [ 428.515129] nixbot[3547]: {"ts": "2026-08-29T13:46:15.283Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a868350d45cf235a21d84a90a239221281f6ba62 \"HTTP/1.1 201 Created\""}2257gitlab # [ 428.517977] nixbot[3547]: {"ts": "2026-08-29T13:46:15.292Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-a868350d45cf-4"}2258gitlab # [ 428.520266] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:14.838Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"d9551741a4e430ff9881d4e7","created_at":"2026-08-29T13:46:11.352Z","trace_propagation_headers":{"sentry-trace":"c3363060204f4669b7cc50d700349846-15c77938907a4950","baggage":"sentry-trace_id=c3363060204f4669b7cc50d700349846,sentry-release=Unknown"},"correlation_id":"01M16W7R5X03E0YY4H97G573W6","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:11.362Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-d9551741a4e430ff9881d4e7: start","job_status":"start","queue_duration_s":3.475288,"scheduling_latency_s":3.47533}2259gitlab # [ 428.536213] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:14.888Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"d9551741a4e430ff9881d4e7","created_at":"2026-08-29T13:46:11.352Z","trace_propagation_headers":{"sentry-trace":"c3363060204f4669b7cc50d700349846-15c77938907a4950","baggage":"sentry-trace_id=c3363060204f4669b7cc50d700349846,sentry-release=Unknown"},"correlation_id":"01M16W7R5X03E0YY4H97G573W6","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:11.362Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-d9551741a4e430ff9881d4e7: done: 0.050034 sec","job_status":"done","queue_duration_s":3.475288,"scheduling_latency_s":3.47533,"redis_calls":19,"redis_duration_s":0.003078,"redis_read_bytes":21,"redis_write_bytes":4291,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000608,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000445,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2262,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001488,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000537,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037115,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0088486,"duration_s":0.050034,"completed_at":"2026-08-29T13:46:14.888Z","load_balancing_strategy":"primary","db_duration_s":0.007606,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2260gitlab # [ 428.581344] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:46:15 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 3122261gitlab # [ 428.583857] gitaly[896]: time="2026-08-29T13:46:15.051Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=592 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M16WAQ1SB3CB1X16BYHDCNWX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-29T13:46:45.042" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-29T13:46:15.042" grpc.time_ms=9.223 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2262gitlab # [ 428.597979] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:14.890Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","198cabc4b9613c1583e432c0"],"class":"WebHooks::LogExecutionWorker","jid":"cd661c5ec74be6034cc22fe9","created_at":"2026-08-29T13:46:13.120Z","trace_propagation_headers":{"sentry-trace":"c3363060204f4669b7cc50d700349846-5149bfd40be343c5","baggage":"sentry-trace_id=c3363060204f4669b7cc50d700349846,sentry-release=Unknown"},"correlation_id":"01M16W7R5X03E0YY4H97G573W6","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b03765ad0926332dbc3a674b615fd5337a9b66c2fa58c7d7465e5c30a326f050","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:13.135Z","job_size_bytes":2593,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-cd661c5ec74be6034cc22fe9: start","job_status":"start","queue_duration_s":1.755406,"scheduling_latency_s":1.755425}2263gitlab # [ 428.615077] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:14.955Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","198cabc4b9613c1583e432c0"],"class":"WebHooks::LogExecutionWorker","jid":"cd661c5ec74be6034cc22fe9","created_at":"2026-08-29T13:46:13.120Z","trace_propagation_headers":{"sentry-trace":"c3363060204f4669b7cc50d700349846-5149bfd40be343c5","baggage":"sentry-trace_id=c3363060204f4669b7cc50d700349846,sentry-release=Unknown"},"correlation_id":"01M16W7R5X03E0YY4H97G573W6","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b03765ad0926332dbc3a674b615fd5337a9b66c2fa58c7d7465e5c30a326f050","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:13.135Z","job_size_bytes":2593,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-cd661c5ec74be6034cc22fe9: done: 0.065135 sec","job_status":"done","queue_duration_s":1.755406,"scheduling_latency_s":1.755425,"redis_calls":10,"redis_duration_s":0.0028669999999999998,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000398,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001169,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0013,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.01,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.01,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042695,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004076,"duration_s":0.065135,"completed_at":"2026-08-29T13:46:14.955Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015105,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2264gitlab # [ 428.660372] gitaly[896]: time="2026-08-29T13:46:15.066Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M16WAQ1SB3CB1X16BYHDCNWX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-29T13:46:25.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-29T13:46:15.058" grpc.time_ms=7.817 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2265gitlab # [ 428.674872] gitaly[896]: time="2026-08-29T13:46:15.098Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M16WANR7VK6295REW4KTYRM6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3895 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-29T13:46:15.098" grpc.time_ms=0.444 pid=896 span.kind=server system=grpc2266gitlab # [ 428.684718] nixbot[3547]: {"ts": "2026-08-29T13:46:15.426Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-a868350d45cf-4", "argv0": "bwrap"}2267gitlab # [ 428.687029] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:14.956Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"9c359005a97eee43240f89af","created_at":"2026-08-29T13:46:13.963Z","trace_propagation_headers":{"sentry-trace":"016a238497484464b080db9a536755ec-bc0ac5a6f06f44f0","baggage":"sentry-trace_id=016a238497484464b080db9a536755ec,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M16WANR7VK6295REW4KTYRM6","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:13.973Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-9c359005a97eee43240f89af: start","job_status":"start","queue_duration_s":0.982894,"scheduling_latency_s":0.982912}2268gitlab # [ 428.702983] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:15.264Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"9c359005a97eee43240f89af","created_at":"2026-08-29T13:46:13.963Z","trace_propagation_headers":{"sentry-trace":"016a238497484464b080db9a536755ec-bc0ac5a6f06f44f0","baggage":"sentry-trace_id=016a238497484464b080db9a536755ec,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M16WANR7VK6295REW4KTYRM6","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:13.973Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3497,"job_status":"rescheduled","message":"PipelineProcessWorker JID-9c359005a97eee43240f89af: rescheduled"}2269gitlab # [ 428.718037] gitaly[896]: time="2026-08-29T13:46:15.101Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M16WAQ1SB3CB1X16BYHDCNWX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-29T13:46:25.049" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-29T13:46:15.101" grpc.time_ms=0.312 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2270gitlab # [ 428.729044] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:15.272Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"9c359005a97eee43240f89af","created_at":"2026-08-29T13:46:13.963Z","trace_propagation_headers":{"sentry-trace":"016a238497484464b080db9a536755ec-bc0ac5a6f06f44f0","baggage":"sentry-trace_id=016a238497484464b080db9a536755ec,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M16WANR7VK6295REW4KTYRM6","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:13.973Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-9c359005a97eee43240f89af: done: 0.316144 sec","job_status":"done","queue_duration_s":0.982894,"scheduling_latency_s":0.982912,"gitaly_calls":3,"gitaly_duration_s":0.100066,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.013613,"redis_read_bytes":148,"redis_write_bytes":18014,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.001161,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000971,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.002676,"redis_queues_read_bytes":26,"redis_queues_write_bytes":12313,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.004197,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000432,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000527,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002488,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.035,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.013,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.013,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.018,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.179866,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.27417164,"duration_s":0.316144,"completed_at":"2026-08-29T13:46:15.272Z","load_balancing_strategy":"primary","db_duration_s":0.035782,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2271gitlab # [ 428.780176] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:15.275Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","7c21d85e4fa20fc509815091"],"class":"WebHooks::LogExecutionWorker","jid":"490f1bdb9a84ecb478c5bd90","created_at":"2026-08-29T13:46:14.203Z","trace_propagation_headers":{"sentry-trace":"5233baf4d15644ecacc820dd114971ef-8c81048bb0b742fd","baggage":"sentry-trace_id=5233baf4d15644ecacc820dd114971ef,sentry-release=Unknown"},"correlation_id":"01M16W7YEZ388PJ3RN04JJE16S","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:240210b9a0d304bd5a407943bace54b8f245b4e048f271e981572363bcb756d5","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:14.206Z","job_size_bytes":2592,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-490f1bdb9a84ecb478c5bd90: start","job_status":"start","queue_duration_s":1.068147,"scheduling_latency_s":1.068175}2272gitlab # [ 428.796803] gitaly[896]: time="2026-08-29T13:46:15.119Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M16WAQ1SB3CB1X16BYHDCNWX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-29T13:46:25.056" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-29T13:46:15.106" grpc.time_ms=12.823 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2273gitlab # [ 428.809837] gitaly[896]: time="2026-08-29T13:46:15.128Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M16WANR7VK6295REW4KTYRM6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-29T13:46:15.128" grpc.time_ms=0.665 pid=896 span.kind=server system=grpc2274gitlab # [ 428.819450] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:15.303Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","7c21d85e4fa20fc509815091"],"class":"WebHooks::LogExecutionWorker","jid":"490f1bdb9a84ecb478c5bd90","created_at":"2026-08-29T13:46:14.203Z","trace_propagation_headers":{"sentry-trace":"5233baf4d15644ecacc820dd114971ef-8c81048bb0b742fd","baggage":"sentry-trace_id=5233baf4d15644ecacc820dd114971ef,sentry-release=Unknown"},"correlation_id":"01M16W7YEZ388PJ3RN04JJE16S","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:240210b9a0d304bd5a407943bace54b8f245b4e048f271e981572363bcb756d5","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:14.206Z","job_size_bytes":2592,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-490f1bdb9a84ecb478c5bd90: done: 0.028286 sec","job_status":"done","queue_duration_s":1.068147,"scheduling_latency_s":1.068175,"redis_calls":7,"redis_duration_s":0.001279,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00095,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000329,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020483,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028286,"completed_at":"2026-08-29T13:46:15.303Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003274,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2275gitlab # [ 428.862826] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:15.305Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"4ca7bb55735ee85ad7f78ff0","created_at":"2026-08-29T13:46:14.873Z","trace_propagation_headers":{"sentry-trace":"c3363060204f4669b7cc50d700349846-d7581f38e1d84b92","baggage":"sentry-trace_id=c3363060204f4669b7cc50d700349846,sentry-release=Unknown"},"correlation_id":"01M16W7R5X03E0YY4H97G573W6","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:14.879Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-4ca7bb55735ee85ad7f78ff0: start","job_status":"start","queue_duration_s":0.42536,"scheduling_latency_s":0.425386}2276gitlab # [ 428.880915] gitaly[896]: time="2026-08-29T13:46:15.151Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M16WANR7VK6295REW4KTYRM6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3895 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-29T13:46:15.150" grpc.time_ms=0.383 pid=896 span.kind=server system=grpc2277gitlab # [ 428.890801] gitaly[896]: time="2026-08-29T13:46:15.156Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M16WANR7VK6295REW4KTYRM6 diskcache=7a38de8e-1114-4fdd-b280-7c68946bfd83 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-29T13:46:45.064" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-29T13:46:15.065" pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2278gitlab # [ 428.900912] nix-daemon[3777]: accepted connection from pid 4426, user nixbot2279gitlab # [ 428.901887] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:15.419Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"4ca7bb55735ee85ad7f78ff0","created_at":"2026-08-29T13:46:14.873Z","trace_propagation_headers":{"sentry-trace":"c3363060204f4669b7cc50d700349846-d7581f38e1d84b92","baggage":"sentry-trace_id=c3363060204f4669b7cc50d700349846,sentry-release=Unknown"},"correlation_id":"01M16W7R5X03E0YY4H97G573W6","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:14.879Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-4ca7bb55735ee85ad7f78ff0: done: 0.11461 sec","job_status":"done","queue_duration_s":0.42536,"scheduling_latency_s":0.425386,"redis_calls":11,"redis_duration_s":0.001942,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000402,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001187,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000353,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.008,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.080287,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00029836,"duration_s":0.11461,"completed_at":"2026-08-29T13:46:15.419Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.028597,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2280gitlab # [ 428.945922] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:15.421Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"cb75846008676cb4830b64d4","created_at":"2026-08-29T13:46:15.050Z","trace_propagation_headers":{"sentry-trace":"016a238497484464b080db9a536755ec-a358c6d857ad4d06","baggage":"sentry-trace_id=016a238497484464b080db9a536755ec,sentry-release=Unknown"},"correlation_id":"01M16WANR7VK6295REW4KTYRM6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:15.054Z","job_size_bytes":23,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-cb75846008676cb4830b64d4: start","job_status":"start","queue_duration_s":0.366605,"scheduling_latency_s":0.36663}2281gitlab # [ 428.962464] gitaly[896]: time="2026-08-29T13:46:15.156Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=85 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7088 command.oublock=0 command.real_time_ms=86 command.spawn_token_fork_ms=1 command.system_time_ms=63 command.user_time_ms=22 component=gitaly.UnaryServerInterceptor correlation_id=01M16WANR7VK6295REW4KTYRM6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-29T13:46:45.064" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-29T13:46:15.065" grpc.time_ms=90.544 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2282gitlab # [ 428.975504] gitaly[896]: time="2026-08-29T13:46:15.166Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M16WAQ1SB3CB1X16BYHDCNWX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4151 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-29T13:46:15.166" grpc.time_ms=0.302 pid=896 span.kind=server system=grpc2283gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62'2284gitlab # [ 428.985030] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:15.469Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"cb75846008676cb4830b64d4","created_at":"2026-08-29T13:46:15.050Z","trace_propagation_headers":{"sentry-trace":"016a238497484464b080db9a536755ec-a358c6d857ad4d06","baggage":"sentry-trace_id=016a238497484464b080db9a536755ec,sentry-release=Unknown"},"correlation_id":"01M16WANR7VK6295REW4KTYRM6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:15.054Z","job_size_bytes":23,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-cb75846008676cb4830b64d4: done: 0.048459 sec","job_status":"done","queue_duration_s":0.366605,"scheduling_latency_s":0.36663,"redis_calls":7,"redis_duration_s":0.001111,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000808,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000303,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03393,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.048459,"completed_at":"2026-08-29T13:46:15.469Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011319,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2285gitlab # [ 429.027407] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:15.471Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"d461c64ed380f7709af4135b","created_at":"2026-08-29T13:46:15.162Z","trace_propagation_headers":{"sentry-trace":"016a238497484464b080db9a536755ec-a358c6d857ad4d06","baggage":"sentry-trace_id=016a238497484464b080db9a536755ec,sentry-release=Unknown"},"correlation_id":"01M16WANR7VK6295REW4KTYRM6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:15.165Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-d461c64ed380f7709af4135b: start","job_status":"start","queue_duration_s":0.305099,"scheduling_latency_s":0.305118}2286gitlab # [ 429.043093] gitaly[896]: time="2026-08-29T13:46:15.188Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M16WAQ1SB3CB1X16BYHDCNWX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4153 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-29T13:46:15.188" grpc.time_ms=0.427 pid=896 span.kind=server system=grpc2287gitlab # [ 429.052089] gitaly[896]: time="2026-08-29T13:46:15.195Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M16WAQ1SB3CB1X16BYHDCNWX diskcache=c2fb29c7-305c-4a4d-b6c7-b8bd32a4bf7d grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-29T13:46:25.071" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-29T13:46:15.121" pid=896 ref=refs/keep-around/a868350d45cf235a21d84a90a239221281f6ba62 remote_ip="2001:db8:1::1" revision=a868350d45cf235a21d84a90a239221281f6ba62 span.kind=server system=grpc username=root2288gitlab # [ 429.062390] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:15.505Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"d461c64ed380f7709af4135b","created_at":"2026-08-29T13:46:15.162Z","trace_propagation_headers":{"sentry-trace":"016a238497484464b080db9a536755ec-a358c6d857ad4d06","baggage":"sentry-trace_id=016a238497484464b080db9a536755ec,sentry-release=Unknown"},"correlation_id":"01M16WANR7VK6295REW4KTYRM6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:15.165Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-d461c64ed380f7709af4135b: done: 0.034485 sec","job_status":"done","queue_duration_s":0.305099,"scheduling_latency_s":0.305118,"redis_calls":7,"redis_duration_s":0.002254,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00161,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000644,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020953,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034485,"completed_at":"2026-08-29T13:46:15.505Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008865,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2289gitlab # [ 429.105633] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:15.507Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"2f818104552a6748d41db07e","created_at":"2026-08-29T13:46:15.174Z","trace_propagation_headers":{"sentry-trace":"016a238497484464b080db9a536755ec-a358c6d857ad4d06","baggage":"sentry-trace_id=016a238497484464b080db9a536755ec,sentry-release=Unknown"},"correlation_id":"01M16WANR7VK6295REW4KTYRM6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:15.177Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-2f818104552a6748d41db07e: start","job_status":"start","queue_duration_s":0.3296,"scheduling_latency_s":0.329619}2290gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62', in 0.10 seconds)2291(finished: subtest: push delivers the webhook, in 91.93 seconds)2292subtest: eval and build post commit statuses2293gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a868350d45cf235a21d84a90a239221281f6ba62/statuses2294gitlab # [ 429.121311] gitaly[896]: time="2026-08-29T13:46:15.195Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=62 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5047 command.oublock=8 command.real_time_ms=69 command.spawn_token_fork_ms=0 command.system_time_ms=34 command.user_time_ms=28 component=gitaly.UnaryServerInterceptor correlation_id=01M16WAQ1SB3CB1X16BYHDCNWX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-29T13:46:25.071" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-29T13:46:15.121" grpc.time_ms=73.902 pid=896 ref=refs/keep-around/a868350d45cf235a21d84a90a239221281f6ba62 remote_ip="2001:db8:1::1" revision=a868350d45cf235a21d84a90a239221281f6ba62 span.kind=server system=grpc username=root2295gitlab # [ 429.135988] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:15.540Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"2f818104552a6748d41db07e","created_at":"2026-08-29T13:46:15.174Z","trace_propagation_headers":{"sentry-trace":"016a238497484464b080db9a536755ec-a358c6d857ad4d06","baggage":"sentry-trace_id=016a238497484464b080db9a536755ec,sentry-release=Unknown"},"correlation_id":"01M16WANR7VK6295REW4KTYRM6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:15.177Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-2f818104552a6748d41db07e: done: 0.033114 sec","job_status":"done","queue_duration_s":0.3296,"scheduling_latency_s":0.329619,"redis_calls":7,"redis_duration_s":0.001961,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001379,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000582,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020957,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033114,"completed_at":"2026-08-29T13:46:15.540Z","load_balancing_strategy":"primary","db_duration_s":0.007996,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2296gitlab # [ 429.178511] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:15.542Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"c51cb6860a6ccdf298f0f0bb","created_at":"2026-08-29T13:46:15.185Z","trace_propagation_headers":{"sentry-trace":"016a238497484464b080db9a536755ec-a358c6d857ad4d06","baggage":"sentry-trace_id=016a238497484464b080db9a536755ec,sentry-release=Unknown"},"correlation_id":"01M16WANR7VK6295REW4KTYRM6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:15.187Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-c51cb6860a6ccdf298f0f0bb: start","job_status":"start","queue_duration_s":0.354502,"scheduling_latency_s":0.354519}2297gitlab # [ 429.194106] nixbot[3547]: INFO: ::ffff:127.0.0.1:46670 - "GET /api/repos/gitlab/root/test-flake/builds?commit=a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 200 OK2298gitlab # [ 429.196066] gitaly[896]: time="2026-08-29T13:46:15.199Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M16WAQ1SB3CB1X16BYHDCNWX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-29T13:46:45.198" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:46:15.198" grpc.time_ms=0.485 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2299gitlab # [ 429.208707] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:15.578Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"c51cb6860a6ccdf298f0f0bb","created_at":"2026-08-29T13:46:15.185Z","trace_propagation_headers":{"sentry-trace":"016a238497484464b080db9a536755ec-a358c6d857ad4d06","baggage":"sentry-trace_id=016a238497484464b080db9a536755ec,sentry-release=Unknown"},"correlation_id":"01M16WANR7VK6295REW4KTYRM6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:15.187Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-c51cb6860a6ccdf298f0f0bb: done: 0.036013 sec","job_status":"done","queue_duration_s":0.354502,"scheduling_latency_s":0.354519,"redis_calls":10,"redis_duration_s":0.002713,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001391,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000771,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000551,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022644,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.036013,"completed_at":"2026-08-29T13:46:15.577Z","load_balancing_strategy":"primary","db_duration_s":0.008413,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2300gitlab # [ 429.252466] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:15.579Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"9b3b87509e190a40b4a76c93","created_at":"2026-08-29T13:46:15.187Z","trace_propagation_headers":{"sentry-trace":"016a238497484464b080db9a536755ec-a358c6d857ad4d06","baggage":"sentry-trace_id=016a238497484464b080db9a536755ec,sentry-release=Unknown"},"correlation_id":"01M16WANR7VK6295REW4KTYRM6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:15.189Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-9b3b87509e190a40b4a76c93: start","job_status":"start","queue_duration_s":0.389971,"scheduling_latency_s":0.389989}2301gitlab # [ 429.269450] gitaly[896]: time="2026-08-29T13:46:15.213Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M16WANR7VK6295REW4KTYRM6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-29T13:46:45.112" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:46:15.212" grpc.time_ms=0.914 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2302gitlab # [ 429.282288] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:15.611Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"9b3b87509e190a40b4a76c93","created_at":"2026-08-29T13:46:15.187Z","trace_propagation_headers":{"sentry-trace":"016a238497484464b080db9a536755ec-a358c6d857ad4d06","baggage":"sentry-trace_id=016a238497484464b080db9a536755ec,sentry-release=Unknown"},"correlation_id":"01M16WANR7VK6295REW4KTYRM6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:15.189Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-9b3b87509e190a40b4a76c93: done: 0.031273 sec","job_status":"done","queue_duration_s":0.389971,"scheduling_latency_s":0.389989,"redis_calls":7,"redis_duration_s":0.002059,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001532,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000527,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019655,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031273,"completed_at":"2026-08-29T13:46:15.610Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007092,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2303gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a868350d45cf235a21d84a90a239221281f6ba62/statuses, in 0.21 seconds)2304gitlab # [ 429.327144] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:15.612Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"efc383264a2378a0fc53b9f5","created_at":"2026-08-29T13:46:15.190Z","trace_propagation_headers":{"sentry-trace":"016a238497484464b080db9a536755ec-a358c6d857ad4d06","baggage":"sentry-trace_id=016a238497484464b080db9a536755ec,sentry-release=Unknown"},"correlation_id":"01M16WANR7VK6295REW4KTYRM6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:15.192Z","job_size_bytes":19,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-efc383264a2378a0fc53b9f5: start","job_status":"start","queue_duration_s":0.42017,"scheduling_latency_s":0.420188}2305gitlab # [ 429.342924] gitaly[896]: time="2026-08-29T13:46:15.254Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M16WANR7VK6295REW4KTYRM6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-29T13:46:45.153" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:46:15.254" grpc.time_ms=0.506 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2306gitlab # [ 429.356052] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:46:16 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/a868350d45cf235a21d84a90a239221281f6ba62/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1482307gitlab # [ 429.358705] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:15.641Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"efc383264a2378a0fc53b9f5","created_at":"2026-08-29T13:46:15.190Z","trace_propagation_headers":{"sentry-trace":"016a238497484464b080db9a536755ec-a358c6d857ad4d06","baggage":"sentry-trace_id=016a238497484464b080db9a536755ec,sentry-release=Unknown"},"correlation_id":"01M16WANR7VK6295REW4KTYRM6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:15.192Z","job_size_bytes":19,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-efc383264a2378a0fc53b9f5: done: 0.028539 sec","job_status":"done","queue_duration_s":0.42017,"scheduling_latency_s":0.420188,"redis_calls":8,"redis_duration_s":0.001888,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001465,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000423,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016134,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028539,"completed_at":"2026-08-29T13:46:15.641Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00739,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2308gitlab # [ 429.400668] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:15.642Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"e753ff94f6279edfb06c452b","created_at":"2026-08-29T13:46:15.193Z","trace_propagation_headers":{"sentry-trace":"016a238497484464b080db9a536755ec-a358c6d857ad4d06","baggage":"sentry-trace_id=016a238497484464b080db9a536755ec,sentry-release=Unknown"},"correlation_id":"01M16WANR7VK6295REW4KTYRM6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:15.195Z","job_size_bytes":66,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-e753ff94f6279edfb06c452b: start","job_status":"start","queue_duration_s":0.447352,"scheduling_latency_s":0.447368}2309gitlab # [ 429.417612] gitaly[896]: time="2026-08-29T13:46:16.029Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M16WAQ1SB3CB1X16BYHDCNWX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-29T13:46:46.027" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:46:16.027" grpc.time_ms=1.606 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2310gitlab # [ 429.430244] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:15.669Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"e753ff94f6279edfb06c452b","created_at":"2026-08-29T13:46:15.193Z","trace_propagation_headers":{"sentry-trace":"016a238497484464b080db9a536755ec-a358c6d857ad4d06","baggage":"sentry-trace_id=016a238497484464b080db9a536755ec,sentry-release=Unknown"},"correlation_id":"01M16WANR7VK6295REW4KTYRM6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:15.195Z","job_size_bytes":66,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-e753ff94f6279edfb06c452b: done: 0.026831 sec","job_status":"done","queue_duration_s":0.447352,"scheduling_latency_s":0.447368,"redis_calls":7,"redis_duration_s":0.0026449999999999998,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002054,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000591,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016653,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026831,"completed_at":"2026-08-29T13:46:15.669Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00441,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2311gitlab # [ 429.473535] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:15.671Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"5a821c9ac1e9d5131b377538","created_at":"2026-08-29T13:46:15.195Z","trace_propagation_headers":{"sentry-trace":"016a238497484464b080db9a536755ec-a358c6d857ad4d06","baggage":"sentry-trace_id=016a238497484464b080db9a536755ec,sentry-release=Unknown"},"correlation_id":"01M16WANR7VK6295REW4KTYRM6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:15.197Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-5a821c9ac1e9d5131b377538: start","job_status":"start","queue_duration_s":0.473426,"scheduling_latency_s":0.473442}2312gitlab # [ 429.489938] gitaly[896]: time="2026-08-29T13:46:16.091Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M16WAR1JC73EVEPSC4XDKMSR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-29T13:46:46.087" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:46:16.089" grpc.time_ms=1.235 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2313gitlab # [ 429.503797] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:15.700Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"5a821c9ac1e9d5131b377538","created_at":"2026-08-29T13:46:15.195Z","trace_propagation_headers":{"sentry-trace":"016a238497484464b080db9a536755ec-a358c6d857ad4d06","baggage":"sentry-trace_id=016a238497484464b080db9a536755ec,sentry-release=Unknown"},"correlation_id":"01M16WANR7VK6295REW4KTYRM6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:15.197Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-5a821c9ac1e9d5131b377538: done: 0.029038 sec","job_status":"done","queue_duration_s":0.473426,"scheduling_latency_s":0.473442,"redis_calls":7,"redis_duration_s":0.0019450000000000001,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001417,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000528,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016773,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029038,"completed_at":"2026-08-29T13:46:15.699Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007996,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2314gitlab # [ 429.546669] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:15.701Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"b1f255e83fadd02b6829555f","created_at":"2026-08-29T13:46:15.198Z","trace_propagation_headers":{"sentry-trace":"016a238497484464b080db9a536755ec-a358c6d857ad4d06","baggage":"sentry-trace_id=016a238497484464b080db9a536755ec,sentry-release=Unknown"},"correlation_id":"01M16WANR7VK6295REW4KTYRM6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:15.199Z","job_size_bytes":6,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-b1f255e83fadd02b6829555f: start","job_status":"start","queue_duration_s":0.502238,"scheduling_latency_s":0.502257}2315gitlab # [ 429.562387] gitaly[896]: time="2026-08-29T13:46:16.097Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M16WAQ1SB3CB1X16BYHDCNWX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-29T13:46:46.093" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:46:16.095" grpc.time_ms=1.73 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2316gitlab # [ 429.574712] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:15.716Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"b1f255e83fadd02b6829555f","created_at":"2026-08-29T13:46:15.198Z","trace_propagation_headers":{"sentry-trace":"016a238497484464b080db9a536755ec-a358c6d857ad4d06","baggage":"sentry-trace_id=016a238497484464b080db9a536755ec,sentry-release=Unknown"},"correlation_id":"01M16WANR7VK6295REW4KTYRM6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:15.199Z","job_size_bytes":6,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-b1f255e83fadd02b6829555f: done: 0.014477 sec","job_status":"done","queue_duration_s":0.502238,"scheduling_latency_s":0.502257,"redis_calls":7,"redis_duration_s":0.0017079999999999999,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001245,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000463,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008951,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014477,"completed_at":"2026-08-29T13:46:15.716Z","load_balancing_strategy":"primary","db_duration_s":0.000663,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2317gitlab # [ 429.616139] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:15.717Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"245ee02f84787099116d81c9","created_at":"2026-08-29T13:46:15.200Z","trace_propagation_headers":{"sentry-trace":"016a238497484464b080db9a536755ec-a358c6d857ad4d06","baggage":"sentry-trace_id=016a238497484464b080db9a536755ec,sentry-release=Unknown"},"correlation_id":"01M16WANR7VK6295REW4KTYRM6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:15.201Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-245ee02f84787099116d81c9: start","job_status":"start","queue_duration_s":0.515982,"scheduling_latency_s":0.515998}2318gitlab # [ 429.631160] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:15.743Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"245ee02f84787099116d81c9","created_at":"2026-08-29T13:46:15.200Z","trace_propagation_headers":{"sentry-trace":"016a238497484464b080db9a536755ec-a358c6d857ad4d06","baggage":"sentry-trace_id=016a238497484464b080db9a536755ec,sentry-release=Unknown"},"correlation_id":"01M16WANR7VK6295REW4KTYRM6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:15.201Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-245ee02f84787099116d81c9: done: 0.025785 sec","job_status":"done","queue_duration_s":0.515982,"scheduling_latency_s":0.515998,"redis_calls":7,"redis_duration_s":0.001888,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001338,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00055,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015955,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025785,"completed_at":"2026-08-29T13:46:15.743Z","load_balancing_strategy":"primary","db_duration_s":0.005611,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2319gitlab # [ 429.672184] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:15.745Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"2d33a17472c6d95dbae31198","created_at":"2026-08-29T13:46:15.202Z","trace_propagation_headers":{"sentry-trace":"3b2e915e94dc4e3c98eac05f20936cc6-902c814f1e474071","baggage":"sentry-trace_id=3b2e915e94dc4e3c98eac05f20936cc6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M16WAQ1SB3CB1X16BYHDCNWX","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:15.206Z","job_size_bytes":65,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-2d33a17472c6d95dbae31198: start","job_status":"start","queue_duration_s":0.538816,"scheduling_latency_s":0.538835}2320gitlab # [ 429.689332] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:15.778Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"2d33a17472c6d95dbae31198","created_at":"2026-08-29T13:46:15.202Z","trace_propagation_headers":{"sentry-trace":"3b2e915e94dc4e3c98eac05f20936cc6-902c814f1e474071","baggage":"sentry-trace_id=3b2e915e94dc4e3c98eac05f20936cc6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M16WAQ1SB3CB1X16BYHDCNWX","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:15.206Z","job_size_bytes":65,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-2d33a17472c6d95dbae31198: done: 0.033305 sec","job_status":"done","queue_duration_s":0.538816,"scheduling_latency_s":0.538835,"redis_calls":7,"redis_duration_s":0.001866,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001347,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000519,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020172,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033305,"completed_at":"2026-08-29T13:46:15.778Z","load_balancing_strategy":"primary","db_duration_s":0.008872,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2321gitlab # [ 429.734002] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:15.780Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"2709b5228630a78c71ba4fc1","created_at":"2026-08-29T13:46:15.206Z","trace_propagation_headers":{"sentry-trace":"3b2e915e94dc4e3c98eac05f20936cc6-902c814f1e474071","baggage":"sentry-trace_id=3b2e915e94dc4e3c98eac05f20936cc6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M16WAQ1SB3CB1X16BYHDCNWX","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:15.209Z","job_size_bytes":65,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-2709b5228630a78c71ba4fc1: start","job_status":"start","queue_duration_s":0.570174,"scheduling_latency_s":0.570192}2322gitlab # [ 429.785925] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:15.851Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"2709b5228630a78c71ba4fc1","created_at":"2026-08-29T13:46:15.206Z","trace_propagation_headers":{"sentry-trace":"3b2e915e94dc4e3c98eac05f20936cc6-902c814f1e474071","baggage":"sentry-trace_id=3b2e915e94dc4e3c98eac05f20936cc6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M16WAQ1SB3CB1X16BYHDCNWX","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:15.209Z","job_size_bytes":65,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-2709b5228630a78c71ba4fc1: done: 0.071645 sec","job_status":"done","queue_duration_s":0.570174,"scheduling_latency_s":0.570192,"redis_calls":10,"redis_duration_s":0.003438,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001753,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001685,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038686,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.071645,"completed_at":"2026-08-29T13:46:15.851Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.026387,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2323gitlab # [ 429.857966] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:15.855Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"8c345b7e8c601314f276012e","created_at":"2026-08-29T13:46:15.263Z","trace_propagation_headers":{"sentry-trace":"3b2e915e94dc4e3c98eac05f20936cc6-902c814f1e474071","baggage":"sentry-trace_id=3b2e915e94dc4e3c98eac05f20936cc6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M16WAQ1SB3CB1X16BYHDCNWX","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:15.266Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-8c345b7e8c601314f276012e: start","job_status":"start","queue_duration_s":0.589251,"scheduling_latency_s":0.589295}2324gitlab # [ 429.879892] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:16.114Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"8c345b7e8c601314f276012e","created_at":"2026-08-29T13:46:15.263Z","trace_propagation_headers":{"sentry-trace":"3b2e915e94dc4e3c98eac05f20936cc6-902c814f1e474071","baggage":"sentry-trace_id=3b2e915e94dc4e3c98eac05f20936cc6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M16WAQ1SB3CB1X16BYHDCNWX","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:15.266Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-8c345b7e8c601314f276012e: done: 0.259482 sec","job_status":"done","queue_duration_s":0.589251,"scheduling_latency_s":0.589295,"gitaly_calls":2,"gitaly_duration_s":0.011586,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.016531,"redis_read_bytes":79,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.004553,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001527,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000407,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002513,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000548,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000769,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001661,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.045,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.007,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.012,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.023,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.193896,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.18808622,"duration_s":0.259482,"completed_at":"2026-08-29T13:46:16.114Z","load_balancing_strategy":"primary","db_duration_s":0.050748,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2325gitlab # [ 429.939077] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:16.117Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"54e90ca82a859fe8c84e40da","created_at":"2026-08-29T13:46:15.265Z","trace_propagation_headers":{"sentry-trace":"016a238497484464b080db9a536755ec-a358c6d857ad4d06","baggage":"sentry-trace_id=016a238497484464b080db9a536755ec,sentry-release=Unknown"},"correlation_id":"01M16WANR7VK6295REW4KTYRM6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:15.267Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-54e90ca82a859fe8c84e40da: start","job_status":"start","queue_duration_s":0.850053,"scheduling_latency_s":0.85008}2326gitlab # [ 429.955648] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:16.157Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"54e90ca82a859fe8c84e40da","created_at":"2026-08-29T13:46:15.265Z","trace_propagation_headers":{"sentry-trace":"016a238497484464b080db9a536755ec-a358c6d857ad4d06","baggage":"sentry-trace_id=016a238497484464b080db9a536755ec,sentry-release=Unknown"},"correlation_id":"01M16WANR7VK6295REW4KTYRM6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:15.267Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-54e90ca82a859fe8c84e40da: done: 0.040428 sec","job_status":"done","queue_duration_s":0.850053,"scheduling_latency_s":0.85008,"redis_calls":8,"redis_duration_s":0.002989,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002319,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00067,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025656,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.040428,"completed_at":"2026-08-29T13:46:16.157Z","load_balancing_strategy":"primary","db_duration_s":0.007975,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2327gitlab # [ 429.997713] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:16.159Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"add4db9c3494df99587d4691","created_at":"2026-08-29T13:46:16.002Z","trace_propagation_headers":{"sentry-trace":"3b2e915e94dc4e3c98eac05f20936cc6-cefa3064f49c4af0","baggage":"sentry-trace_id=3b2e915e94dc4e3c98eac05f20936cc6,sentry-release=Unknown"},"correlation_id":"01M16WAQ1SB3CB1X16BYHDCNWX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:16.006Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-add4db9c3494df99587d4691: start","job_status":"start","queue_duration_s":0.153614,"scheduling_latency_s":0.153638}2328gitlab # [ 430.013870] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:16.206Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"add4db9c3494df99587d4691","created_at":"2026-08-29T13:46:16.002Z","trace_propagation_headers":{"sentry-trace":"3b2e915e94dc4e3c98eac05f20936cc6-cefa3064f49c4af0","baggage":"sentry-trace_id=3b2e915e94dc4e3c98eac05f20936cc6,sentry-release=Unknown"},"correlation_id":"01M16WAQ1SB3CB1X16BYHDCNWX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:16.006Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-add4db9c3494df99587d4691: done: 0.046882 sec","job_status":"done","queue_duration_s":0.153614,"scheduling_latency_s":0.153638,"redis_calls":7,"redis_duration_s":0.0021319999999999998,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001522,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00061,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033316,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.046882,"completed_at":"2026-08-29T13:46:16.206Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008424,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2329gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a868350d45cf235a21d84a90a239221281f6ba62/statuses2330gitlab # [ 430.527493] gitaly[896]: time="2026-08-29T13:46:17.331Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M16WAS881XMDM45DKA0CR0B1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-29T13:46:47.329" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:46:17.329" grpc.time_ms=1.181 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2331gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a868350d45cf235a21d84a90a239221281f6ba62/statuses, in 0.24 seconds)2332gitlab # [ 430.582813] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:46:17 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/a868350d45cf235a21d84a90a239221281f6ba62/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1612333gitlab # [ 430.828700] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:17.631Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"35a283bdb9e8e19f3336caa7","created_at":"2026-08-29T13:46:17.423Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dbb80de8214576189a39b20a7863bb8b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:17.627Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-35a283bdb9e8e19f3336caa7: start","job_status":"start","queue_duration_s":0.003627,"scheduling_latency_s":0.003683}2334gitlab # [ 430.925498] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:17.730Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}2335gitlab # [ 430.972064] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:17.775Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"35a283bdb9e8e19f3336caa7","created_at":"2026-08-29T13:46:17.423Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dbb80de8214576189a39b20a7863bb8b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:17.627Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-35a283bdb9e8e19f3336caa7: done: 0.144283 sec","job_status":"done","queue_duration_s":0.003627,"scheduling_latency_s":0.003683,"redis_calls":9,"redis_duration_s":0.016818,"redis_read_bytes":7,"redis_write_bytes":1178,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003733,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.010621,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002464,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043541,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.144283,"completed_at":"2026-08-29T13:46:17.775Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.02013,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2336gitlab # [ 431.063920] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:17.787Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"f99c5e50b46c77e4c224a3b0","created_at":"2026-08-29T13:46:17.637Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9d3236ad836747f8a8651f53a53534b2","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:17.650Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-f99c5e50b46c77e4c224a3b0: start","job_status":"start","queue_duration_s":0.137007,"scheduling_latency_s":0.137055}2337gitlab # [ 431.142987] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:17.946Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"f99c5e50b46c77e4c224a3b0","created_at":"2026-08-29T13:46:17.637Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9d3236ad836747f8a8651f53a53534b2","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:17.650Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-f99c5e50b46c77e4c224a3b0: done: 0.159558 sec","job_status":"done","queue_duration_s":0.137007,"scheduling_latency_s":0.137055,"redis_calls":11,"redis_duration_s":0.021639,"redis_read_bytes":9,"redis_write_bytes":1464,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002847,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.009315,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.009477,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049451,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00376118,"exclusive_lock_hold_duration_s":0.02416466,"duration_s":0.159558,"completed_at":"2026-08-29T13:46:17.946Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.02078,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2338gitlab # [ 431.224332] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:17.967Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"126b13b4a05fdf071a4f3915","created_at":"2026-08-29T13:46:17.678Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"54bcad52caa3c49d7aa9f91b70c38f22","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:17.696Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-126b13b4a05fdf071a4f3915: start","job_status":"start","queue_duration_s":0.271706,"scheduling_latency_s":0.271753}2339gitlab # [ 431.343498] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:18.145Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"126b13b4a05fdf071a4f3915","created_at":"2026-08-29T13:46:17.678Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"54bcad52caa3c49d7aa9f91b70c38f22","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:17.696Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-126b13b4a05fdf071a4f3915: done: 0.177207 sec","job_status":"done","queue_duration_s":0.271706,"scheduling_latency_s":0.271753,"redis_calls":11,"redis_duration_s":0.020926,"redis_read_bytes":8,"redis_write_bytes":1094,"redis_cache_calls":2,"redis_cache_duration_s":0.004678,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003193,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.007617,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":482,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005438,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036354,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.177207,"completed_at":"2026-08-29T13:46:18.144Z","load_balancing_strategy":"primary","db_duration_s":0.010467,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2340gitlab # [ 431.436593] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:18.156Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"8ff4c34369e9d7715bc53e70","created_at":"2026-08-29T13:46:17.712Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"545ccaa7b2b3f41a77156fe271b67d64","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:17.736Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-8ff4c34369e9d7715bc53e70: start","job_status":"start","queue_duration_s":0.419645,"scheduling_latency_s":0.419693}2341gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a868350d45cf235a21d84a90a239221281f6ba62/statuses2342gitlab # [ 431.512045] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:18.312Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"8ff4c34369e9d7715bc53e70","created_at":"2026-08-29T13:46:17.712Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"545ccaa7b2b3f41a77156fe271b67d64","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:17.736Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-8ff4c34369e9d7715bc53e70: done: 0.156135 sec","job_status":"done","queue_duration_s":0.419645,"scheduling_latency_s":0.419693,"redis_calls":9,"redis_duration_s":0.019319,"redis_read_bytes":7,"redis_write_bytes":1026,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002774,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":315,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.012391,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004154,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.028,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046939,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.156135,"completed_at":"2026-08-29T13:46:18.312Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.031284,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2343gitlab # [ 431.621091] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:18.329Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"c701491bd0c4371a5e6488cc","created_at":"2026-08-29T13:46:17.766Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ea2876cadf588dee69acdb34fd6b3e34","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:17.784Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-c701491bd0c4371a5e6488cc: start","job_status":"start","queue_duration_s":0.545161,"scheduling_latency_s":0.545207}2344gitlab # [ 431.747609] gitaly[896]: time="2026-08-29T13:46:18.551Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M16WATEQ7RV5HMXCS0BMV28C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-29T13:46:48.548" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:46:18.549" grpc.time_ms=1.325 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2345gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a868350d45cf235a21d84a90a239221281f6ba62/statuses, in 0.22 seconds)2346gitlab # [ 431.802792] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:46:18 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/a868350d45cf235a21d84a90a239221281f6ba62/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1512347gitlab # [ 431.911566] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:18.714Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"c701491bd0c4371a5e6488cc","created_at":"2026-08-29T13:46:17.766Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ea2876cadf588dee69acdb34fd6b3e34","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:17.784Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-c701491bd0c4371a5e6488cc: done: 0.384543 sec","job_status":"done","queue_duration_s":0.545161,"scheduling_latency_s":0.545207,"redis_calls":13,"redis_duration_s":0.044944000000000005,"redis_read_bytes":11,"redis_write_bytes":1780,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.003976,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.007668,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.0333,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.171,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.068,"db_ci_duration_s":0.103,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.107784,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00241734,"exclusive_lock_hold_duration_s":0.17932674,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.384543,"completed_at":"2026-08-29T13:46:18.714Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.186091,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2348gitlab # [ 432.017803] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:18.751Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"0189bd5123e530962730cdf6","created_at":"2026-08-29T13:46:17.798Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d2ce74f652da05c10825c9cbb7b1c7be","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:17.810Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-0189bd5123e530962730cdf6: start","job_status":"start","queue_duration_s":0.941062,"scheduling_latency_s":0.941113}2349gitlab # [ 432.071787] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:18.875Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"0189bd5123e530962730cdf6","created_at":"2026-08-29T13:46:17.798Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d2ce74f652da05c10825c9cbb7b1c7be","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:17.810Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-0189bd5123e530962730cdf6: done: 0.124112 sec","job_status":"done","queue_duration_s":0.941062,"scheduling_latency_s":0.941113,"redis_calls":11,"redis_duration_s":0.004906,"redis_read_bytes":9,"redis_write_bytes":1459,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001793,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00226,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000853,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.051491,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.124112,"completed_at":"2026-08-29T13:46:18.875Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011071,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2350gitlab # [ 432.157392] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:18.878Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"1e1e74b526f6b8586eb56c1d","created_at":"2026-08-29T13:46:17.839Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0b0fef624bf98ae0d9315abca61c33c1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:17.859Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-1e1e74b526f6b8586eb56c1d: start","job_status":"start","queue_duration_s":1.018861,"scheduling_latency_s":1.018896}2351gitlab # [ 432.175631] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:18.898Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}2352gitlab # [ 432.179954] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:18.910Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"1e1e74b526f6b8586eb56c1d","created_at":"2026-08-29T13:46:17.839Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0b0fef624bf98ae0d9315abca61c33c1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:17.859Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-1e1e74b526f6b8586eb56c1d: done: 0.031947 sec","job_status":"done","queue_duration_s":1.018861,"scheduling_latency_s":1.018896,"redis_calls":9,"redis_duration_s":0.00304,"redis_read_bytes":7,"redis_write_bytes":1112,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00069,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001709,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000641,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018949,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031947,"completed_at":"2026-08-29T13:46:18.910Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000752,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2353gitlab # [ 432.229294] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:18.912Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"053f65ffa3d387eafb81bb1d","created_at":"2026-08-29T13:46:17.882Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"01c0e63d048fedce8d07eae832edd7e4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-29T13:46:17.896Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-053f65ffa3d387eafb81bb1d: start","job_status":"start","queue_duration_s":1.015611,"scheduling_latency_s":1.015639}2354gitlab # [ 432.242660] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:18.930Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}2355gitlab # [ 432.246432] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:18.939Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"053f65ffa3d387eafb81bb1d","created_at":"2026-08-29T13:46:17.882Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"01c0e63d048fedce8d07eae832edd7e4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-29T13:46:17.896Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-053f65ffa3d387eafb81bb1d: done: 0.027243 sec","job_status":"done","queue_duration_s":1.015611,"scheduling_latency_s":1.015639,"redis_calls":9,"redis_duration_s":0.002887,"redis_read_bytes":7,"redis_write_bytes":1152,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000647,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001533,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000707,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016431,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027243,"completed_at":"2026-08-29T13:46:18.939Z","load_balancing_strategy":"primary","db_duration_s":0.000629,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2356gitlab # [ 432.287338] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:18.941Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"c71c3febdceb06f1b3a4d69f","created_at":"2026-08-29T13:46:17.910Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"30c82d6b651316d48b0ce825ef1b898a","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:17.927Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-c71c3febdceb06f1b3a4d69f: start","job_status":"start","queue_duration_s":1.01408,"scheduling_latency_s":1.014103}2357gitlab # [ 432.301622] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:18.969Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"c71c3febdceb06f1b3a4d69f","created_at":"2026-08-29T13:46:17.910Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"30c82d6b651316d48b0ce825ef1b898a","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:17.927Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-c71c3febdceb06f1b3a4d69f: done: 0.027712 sec","job_status":"done","queue_duration_s":1.01408,"scheduling_latency_s":1.014103,"redis_calls":11,"redis_duration_s":0.003288,"redis_read_bytes":9,"redis_write_bytes":1418,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000602,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001385,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001301,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0161,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0007361,"exclusive_lock_hold_duration_s":0.00408508,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.027712,"completed_at":"2026-08-29T13:46:18.969Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002655,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2358gitlab # [ 432.344573] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:18.971Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"9552e033236fae878804e3aa","created_at":"2026-08-29T13:46:17.963Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7c2e44d692b34b0a51366199174eaa74","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:17.978Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-9552e033236fae878804e3aa: start","job_status":"start","queue_duration_s":0.992606,"scheduling_latency_s":0.992627}2359gitlab # [ 432.358410] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:19.015Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"9552e033236fae878804e3aa","created_at":"2026-08-29T13:46:17.963Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7c2e44d692b34b0a51366199174eaa74","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:17.978Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-9552e033236fae878804e3aa: done: 0.044656 sec","job_status":"done","queue_duration_s":0.992606,"scheduling_latency_s":0.992627,"redis_calls":9,"redis_duration_s":0.002646,"redis_read_bytes":7,"redis_write_bytes":1183,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000575,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001449,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000622,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017936,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.044656,"completed_at":"2026-08-29T13:46:19.015Z","load_balancing_strategy":"primary","db_duration_s":0.018574,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2360gitlab # [ 432.401901] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:19.017Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"aa0c0827d88a0ecf8a78ebbc","created_at":"2026-08-29T13:46:18.030Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"11c2f368d60a5744b42307eb038605d1","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:18.050Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-aa0c0827d88a0ecf8a78ebbc: start","job_status":"start","queue_duration_s":0.967229,"scheduling_latency_s":0.967253}2361gitlab # [ 432.416220] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:19.079Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"aa0c0827d88a0ecf8a78ebbc","created_at":"2026-08-29T13:46:18.030Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"11c2f368d60a5744b42307eb038605d1","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:18.050Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-aa0c0827d88a0ecf8a78ebbc: done: 0.061338 sec","job_status":"done","queue_duration_s":0.967229,"scheduling_latency_s":0.967253,"redis_calls":12,"redis_duration_s":0.004898,"redis_read_bytes":10,"redis_write_bytes":1576,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000779,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002418,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001701,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043836,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01956398,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.061338,"completed_at":"2026-08-29T13:46:19.078Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005055,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2362gitlab # [ 432.460237] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:19.082Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"ed47fd584473d133705536eb","created_at":"2026-08-29T13:46:18.068Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"998b3237e8c491f343a881d50427926d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:18.093Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-ed47fd584473d133705536eb: start","job_status":"start","queue_duration_s":0.988697,"scheduling_latency_s":0.988741}2363gitlab # [ 432.473625] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:19.155Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"ed47fd584473d133705536eb","created_at":"2026-08-29T13:46:18.068Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"998b3237e8c491f343a881d50427926d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:18.093Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-ed47fd584473d133705536eb: done: 0.073022 sec","job_status":"done","queue_duration_s":0.988697,"scheduling_latency_s":0.988741,"redis_calls":18,"redis_duration_s":0.006545,"redis_read_bytes":20,"redis_write_bytes":4698,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001307,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000403,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.003462,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001373,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050268,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.073022,"completed_at":"2026-08-29T13:46:19.155Z","load_balancing_strategy":"primary","db_duration_s":0.0036,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2364gitlab # [ 432.515581] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:19.159Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::PipelineArtifacts::ExpireArtifactsWorker","jid":"ddd0b2ab25faddf4a19b2c14","created_at":"2026-08-29T13:46:18.135Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d6fc1494d6f45cbf969e203b42ed3cb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:35dc78c13bdf78a98c09fc2795030a4961be87ad882288b77a6a3c9be677e4d5","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:18.153Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::ExpireArtifactsWorker JID-ddd0b2ab25faddf4a19b2c14: start","job_status":"start","queue_duration_s":1.00519,"scheduling_latency_s":1.005232}2365gitlab # [ 432.529300] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:19.222Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::PipelineArtifacts::ExpireArtifactsWorker","jid":"ddd0b2ab25faddf4a19b2c14","created_at":"2026-08-29T13:46:18.135Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d6fc1494d6f45cbf969e203b42ed3cb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:35dc78c13bdf78a98c09fc2795030a4961be87ad882288b77a6a3c9be677e4d5","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:18.153Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::ExpireArtifactsWorker JID-ddd0b2ab25faddf4a19b2c14: done: 0.063619 sec","job_status":"done","queue_duration_s":1.00519,"scheduling_latency_s":1.005232,"redis_calls":12,"redis_duration_s":0.00536,"redis_read_bytes":11,"redis_write_bytes":1481,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000991,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002501,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001868,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":548,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040268,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00120916,"exclusive_lock_hold_duration_s":0.01825358,"extra.ci_pipeline_artifacts_expire_artifacts_worker.destroyed_pipeline_artifacts_count":0,"duration_s":0.063619,"completed_at":"2026-08-29T13:46:19.222Z","load_balancing_strategy":"primary","db_duration_s":0.007325,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2366gitlab # [ 432.572830] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:19.225Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"0ef19a6ea81c3b478e8af901","created_at":"2026-08-29T13:46:18.169Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dc97b2a1c86f174b40d463abfaadb6e1","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:18.181Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-0ef19a6ea81c3b478e8af901: start","job_status":"start","queue_duration_s":1.044857,"scheduling_latency_s":1.044893}2367gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a868350d45cf235a21d84a90a239221281f6ba62/statuses2368gitlab # [ 432.871361] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:19.675Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"0ef19a6ea81c3b478e8af901","created_at":"2026-08-29T13:46:18.169Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dc97b2a1c86f174b40d463abfaadb6e1","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:18.181Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-0ef19a6ea81c3b478e8af901: done: 0.450031 sec","job_status":"done","queue_duration_s":1.044857,"scheduling_latency_s":1.044893,"redis_calls":564,"redis_duration_s":0.10660800000000001,"redis_read_bytes":562,"redis_write_bytes":49063,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000664,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001435,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.104509,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.387202,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.450031,"completed_at":"2026-08-29T13:46:19.675Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000791,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2369gitlab # [ 432.930162] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:19.677Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"f23913ff7ced2bbfc6e8f243","created_at":"2026-08-29T13:46:18.192Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8e0f8f136a5a638e163156056e8c6f86","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:18.221Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-f23913ff7ced2bbfc6e8f243: start","job_status":"start","queue_duration_s":1.455158,"scheduling_latency_s":1.455177}2370gitlab # [ 432.945242] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:19.705Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"f23913ff7ced2bbfc6e8f243","created_at":"2026-08-29T13:46:18.192Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8e0f8f136a5a638e163156056e8c6f86","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:18.221Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-f23913ff7ced2bbfc6e8f243: done: 0.028827 sec","job_status":"done","queue_duration_s":1.455158,"scheduling_latency_s":1.455177,"redis_calls":9,"redis_duration_s":0.001309,"redis_read_bytes":7,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000297,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000731,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000281,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017237,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028827,"completed_at":"2026-08-29T13:46:19.705Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006006,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2371gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a868350d45cf235a21d84a90a239221281f6ba62/statuses, in 0.19 seconds)2372gitlab # [ 432.988420] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:19.707Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"c6feddfc489b4c4c62d6e305","created_at":"2026-08-29T13:46:18.238Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2f005f69c7feee2eb7d54d0dcf46d4ad","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-29T13:46:18.256Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-c6feddfc489b4c4c62d6e305: start","job_status":"start","queue_duration_s":1.450908,"scheduling_latency_s":1.450931}2373gitlab # [ 433.003013] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:19.722Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}2374gitlab # [ 433.006469] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:19.728Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"c6feddfc489b4c4c62d6e305","created_at":"2026-08-29T13:46:18.238Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2f005f69c7feee2eb7d54d0dcf46d4ad","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-29T13:46:18.256Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-c6feddfc489b4c4c62d6e305: done: 0.021439 sec","job_status":"done","queue_duration_s":1.450908,"scheduling_latency_s":1.450931,"redis_calls":9,"redis_duration_s":0.004727,"redis_read_bytes":7,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003676,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000762,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000289,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011393,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021439,"completed_at":"2026-08-29T13:46:19.728Z","load_balancing_strategy":"primary","db_duration_s":0.000394,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2375gitlab # [ 433.047730] gitaly[896]: time="2026-08-29T13:46:19.750Z" level=info msg="finished unary call with code OK" catfile.duration_ms=3 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=3 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M16WAVMAXBRF8TTHRTVE18KZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-29T13:46:49.746" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:46:19.746" grpc.time_ms=3.46 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2376gitlab # [ 433.061514] nix-daemon[3777]: accepted connection from pid 4461, user nixbot2377gitlab # [ 433.062465] nix-daemon[3777]: accepted connection from pid 4426, user nixbot2378gitlab # [ 433.063380] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:19.729Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"756a00138e4f27abfa2f59a3","created_at":"2026-08-29T13:46:18.274Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3e4ea14c58480780a30048daaaf1453c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:18.305Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-756a00138e4f27abfa2f59a3: start","job_status":"start","queue_duration_s":1.424293,"scheduling_latency_s":1.42431}2379gitlab # [ 433.077945] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:19.740Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}2380gitlab # [ 433.081302] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:19.747Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"756a00138e4f27abfa2f59a3","created_at":"2026-08-29T13:46:18.274Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3e4ea14c58480780a30048daaaf1453c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:18.305Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-756a00138e4f27abfa2f59a3: done: 0.017429 sec","job_status":"done","queue_duration_s":1.424293,"scheduling_latency_s":1.42431,"redis_calls":9,"redis_duration_s":0.001275,"redis_read_bytes":7,"redis_write_bytes":1185,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000274,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000715,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000286,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010617,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017429,"completed_at":"2026-08-29T13:46:19.747Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000331,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2381gitlab # [ 433.123932] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:46:19 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/a868350d45cf235a21d84a90a239221281f6ba62/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1352382gitlab # [ 433.126679] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:19.748Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"4b2c7c125e9a02cf3d172d56","created_at":"2026-08-29T13:46:18.323Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:18.339Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-4b2c7c125e9a02cf3d172d56: start","job_status":"start","queue_duration_s":1.408919,"scheduling_latency_s":1.408936}2383gitlab # [ 433.160681] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:19.965Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"4b2c7c125e9a02cf3d172d56","created_at":"2026-08-29T13:46:18.323Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:18.339Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-4b2c7c125e9a02cf3d172d56: done: 0.216848 sec","job_status":"done","queue_duration_s":1.408919,"scheduling_latency_s":1.408936,"redis_calls":70,"redis_duration_s":0.015065,"redis_read_bytes":118,"redis_write_bytes":42530,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.004203,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001018,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.009098,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000746,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.200214,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.216848,"completed_at":"2026-08-29T13:46:19.965Z","load_balancing_strategy":"primary","db_duration_s":0.001779,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2384gitlab # [ 433.204258] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:19.966Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"91490a6f02e10de55bdebca0","created_at":"2026-08-29T13:46:18.347Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0466693c1da881ac146cf06b55ccf580","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:18.373Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-91490a6f02e10de55bdebca0: start","job_status":"start","queue_duration_s":1.593721,"scheduling_latency_s":1.593738}2385gitlab # [ 433.218470] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:19.986Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"91490a6f02e10de55bdebca0","created_at":"2026-08-29T13:46:18.347Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0466693c1da881ac146cf06b55ccf580","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:18.373Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-91490a6f02e10de55bdebca0: done: 0.01988 sec","job_status":"done","queue_duration_s":1.593721,"scheduling_latency_s":1.593738,"redis_calls":9,"redis_duration_s":0.002315,"redis_read_bytes":7,"redis_write_bytes":1119,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000549,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001259,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000507,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01065,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01988,"completed_at":"2026-08-29T13:46:19.986Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000798,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2386gitlab # [ 433.260309] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:19.988Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"1247c00b343ac49e3574d159","created_at":"2026-08-29T13:46:18.412Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"52f7992f64932cad7e9f21e65a7d8925","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:18.436Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-1247c00b343ac49e3574d159: start","job_status":"start","queue_duration_s":1.551684,"scheduling_latency_s":1.551699}2387gitlab # [ 433.274293] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.013Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"1247c00b343ac49e3574d159","created_at":"2026-08-29T13:46:18.412Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"52f7992f64932cad7e9f21e65a7d8925","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:18.436Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-1247c00b343ac49e3574d159: done: 0.025465 sec","job_status":"done","queue_duration_s":1.551684,"scheduling_latency_s":1.551699,"redis_calls":9,"redis_duration_s":0.0025770000000000003,"redis_read_bytes":7,"redis_write_bytes":984,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00055,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001484,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000543,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014307,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025465,"completed_at":"2026-08-29T13:46:20.013Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004556,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2388gitlab # [ 433.315953] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.014Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"2cb3836b939ce542026872fb","created_at":"2026-08-29T13:46:18.463Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5785c302af963a42e0db1d3e5b677e55","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-29T13:46:18.508Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-2cb3836b939ce542026872fb: start","job_status":"start","queue_duration_s":1.506652,"scheduling_latency_s":1.506667}2389gitlab # [ 433.329124] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.049Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"2cb3836b939ce542026872fb","created_at":"2026-08-29T13:46:18.463Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5785c302af963a42e0db1d3e5b677e55","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-29T13:46:18.508Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-2cb3836b939ce542026872fb: done: 0.034111 sec","job_status":"done","queue_duration_s":1.506652,"scheduling_latency_s":1.506667,"redis_calls":9,"redis_duration_s":0.002577,"redis_read_bytes":7,"redis_write_bytes":1068,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00054,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001506,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000531,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020155,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034111,"completed_at":"2026-08-29T13:46:20.048Z","load_balancing_strategy":"primary","db_duration_s":0.006065,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2390gitlab # [ 433.369785] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.050Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"8dbc9f596db4191d2c6c32fd","created_at":"2026-08-29T13:46:18.585Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"be4153ebd4e6591863a4c813eed519b4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:18.600Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-8dbc9f596db4191d2c6c32fd: start","job_status":"start","queue_duration_s":1.450079,"scheduling_latency_s":1.450096}2391gitlab # [ 433.384252] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.101Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"8dbc9f596db4191d2c6c32fd","created_at":"2026-08-29T13:46:18.585Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"be4153ebd4e6591863a4c813eed519b4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:18.600Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-8dbc9f596db4191d2c6c32fd: done: 0.051223 sec","job_status":"done","queue_duration_s":1.450079,"scheduling_latency_s":1.450096,"redis_calls":11,"redis_duration_s":0.003382,"redis_read_bytes":9,"redis_write_bytes":1518,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00058,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001398,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001404,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020459,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00079958,"exclusive_lock_hold_duration_s":0.02150332,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.051223,"completed_at":"2026-08-29T13:46:20.101Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.023436,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2392gitlab # [ 433.429796] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.103Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"257a6272f1f5995cb3b54eef","created_at":"2026-08-29T13:46:18.613Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cef40e67e5bdf4798975c48e948dbffc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:18.633Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-257a6272f1f5995cb3b54eef: start","job_status":"start","queue_duration_s":1.469818,"scheduling_latency_s":1.469834}2393gitlab # [ 433.558996] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.363Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"257a6272f1f5995cb3b54eef","created_at":"2026-08-29T13:46:18.613Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cef40e67e5bdf4798975c48e948dbffc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:18.633Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-257a6272f1f5995cb3b54eef: done: 0.260316 sec","job_status":"done","queue_duration_s":1.469818,"scheduling_latency_s":1.469834,"redis_calls":13,"redis_duration_s":0.003386,"redis_read_bytes":11,"redis_write_bytes":1567,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001078,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001189,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001119,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.05,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.05,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.192523,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0005644,"exclusive_lock_hold_duration_s":0.23749844,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.260316,"completed_at":"2026-08-29T13:46:20.363Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.076664,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2394gitlab # [ 433.624914] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.365Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"c0b7466830f106c38666d4b4","created_at":"2026-08-29T13:46:18.679Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5e95c617cfbd308595198241d2657bb0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:18.706Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-c0b7466830f106c38666d4b4: start","job_status":"start","queue_duration_s":1.658535,"scheduling_latency_s":1.658552}2395gitlab # [ 433.644202] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.377Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}2396gitlab # [ 433.648260] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.384Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"c0b7466830f106c38666d4b4","created_at":"2026-08-29T13:46:18.679Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5e95c617cfbd308595198241d2657bb0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:18.706Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-c0b7466830f106c38666d4b4: done: 0.01929 sec","job_status":"done","queue_duration_s":1.658535,"scheduling_latency_s":1.658552,"redis_calls":9,"redis_duration_s":0.002275,"redis_read_bytes":7,"redis_write_bytes":1105,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000523,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001287,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000465,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01121,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01929,"completed_at":"2026-08-29T13:46:20.384Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000709,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2397gitlab # [ 433.691761] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.386Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"a85a66c541a9c55174b41867","created_at":"2026-08-29T13:46:18.745Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0e7faadade739c6999cbdad521c918ea","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:18.759Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-a85a66c541a9c55174b41867: start","job_status":"start","queue_duration_s":1.626701,"scheduling_latency_s":1.626716}2398gitlab # [ 433.705981] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.414Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"a85a66c541a9c55174b41867","created_at":"2026-08-29T13:46:18.745Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-433287ddc4f24710","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0e7faadade739c6999cbdad521c918ea","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:18.759Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-a85a66c541a9c55174b41867: done: 0.028151 sec","job_status":"done","queue_duration_s":1.626701,"scheduling_latency_s":1.626716,"redis_calls":11,"redis_duration_s":0.002958,"redis_read_bytes":9,"redis_write_bytes":1399,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000496,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001273,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001189,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014934,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00054354,"exclusive_lock_hold_duration_s":0.00794432,"duration_s":0.028151,"completed_at":"2026-08-29T13:46:20.414Z","load_balancing_strategy":"primary","db_duration_s":0.004906,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2399gitlab # [ 433.747574] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.415Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0abe2d3c30ec65c8d280ba88","created_at":"2026-08-29T13:46:19.116Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-e8262cc3dd6b4420","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"998b3237e8c491f343a881d50427926d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.138Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0abe2d3c30ec65c8d280ba88: start","job_status":"start","queue_duration_s":1.277577,"scheduling_latency_s":1.277592}2400gitlab # [ 433.760243] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.433Z","message":"No existing merge request to be cleaned up."}2401gitlab # [ 433.761904] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.447Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0abe2d3c30ec65c8d280ba88","created_at":"2026-08-29T13:46:19.116Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-e8262cc3dd6b4420","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"998b3237e8c491f343a881d50427926d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.138Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0abe2d3c30ec65c8d280ba88: done: 0.031368 sec","job_status":"done","queue_duration_s":1.277577,"scheduling_latency_s":1.277592,"redis_calls":12,"redis_duration_s":0.003205,"redis_read_bytes":10,"redis_write_bytes":1323,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000548,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001096,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001561,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018601,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031368,"completed_at":"2026-08-29T13:46:20.446Z","load_balancing_strategy":"primary","db_duration_s":0.005311,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2402gitlab # [ 433.801979] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.448Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"20d8b26f29f57ee4687b75ac","created_at":"2026-08-29T13:46:19.116Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-e8262cc3dd6b4420","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"998b3237e8c491f343a881d50427926d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.138Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-20d8b26f29f57ee4687b75ac: start","job_status":"start","queue_duration_s":1.310294,"scheduling_latency_s":1.310309}2403gitlab # [ 433.815431] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.459Z","message":"No existing merge request to be cleaned up."}2404gitlab # [ 433.817173] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.469Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"20d8b26f29f57ee4687b75ac","created_at":"2026-08-29T13:46:19.116Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-e8262cc3dd6b4420","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"998b3237e8c491f343a881d50427926d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.138Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-20d8b26f29f57ee4687b75ac: done: 0.021223 sec","job_status":"done","queue_duration_s":1.310294,"scheduling_latency_s":1.310309,"redis_calls":10,"redis_duration_s":0.003074,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001133,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001941,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012936,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021223,"completed_at":"2026-08-29T13:46:20.469Z","load_balancing_strategy":"primary","db_duration_s":0.00257,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2405gitlab # [ 433.855728] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.471Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e9bf0330a7d341a984023129","created_at":"2026-08-29T13:46:19.116Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-e8262cc3dd6b4420","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"998b3237e8c491f343a881d50427926d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.138Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e9bf0330a7d341a984023129: start","job_status":"start","queue_duration_s":1.332906,"scheduling_latency_s":1.332922}2406gitlab # [ 433.868255] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.482Z","message":"No existing merge request to be cleaned up."}2407gitlab # [ 433.869895] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.490Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e9bf0330a7d341a984023129","created_at":"2026-08-29T13:46:19.116Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-e8262cc3dd6b4420","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"998b3237e8c491f343a881d50427926d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.138Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e9bf0330a7d341a984023129: done: 0.019534 sec","job_status":"done","queue_duration_s":1.332906,"scheduling_latency_s":1.332922,"redis_calls":10,"redis_duration_s":0.002497,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001049,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001448,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012543,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019534,"completed_at":"2026-08-29T13:46:20.490Z","load_balancing_strategy":"primary","db_duration_s":0.002538,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2408gitlab # [ 433.908329] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.492Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"febf7ff3f808b057aad05dd7","created_at":"2026-08-29T13:46:19.116Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-e8262cc3dd6b4420","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"998b3237e8c491f343a881d50427926d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.138Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-febf7ff3f808b057aad05dd7: start","job_status":"start","queue_duration_s":1.354466,"scheduling_latency_s":1.354481}2409gitlab # [ 433.920296] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.503Z","message":"No existing merge request to be cleaned up."}2410gitlab # [ 433.921912] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.512Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"febf7ff3f808b057aad05dd7","created_at":"2026-08-29T13:46:19.116Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-e8262cc3dd6b4420","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"998b3237e8c491f343a881d50427926d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.138Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-febf7ff3f808b057aad05dd7: done: 0.019502 sec","job_status":"done","queue_duration_s":1.354466,"scheduling_latency_s":1.354481,"redis_calls":10,"redis_duration_s":0.0025139999999999997,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001039,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001475,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012471,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019502,"completed_at":"2026-08-29T13:46:20.512Z","load_balancing_strategy":"primary","db_duration_s":0.002561,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2411gitlab # [ 433.960928] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.513Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"06d3f28064fcc30fe2444dd6","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-06d3f28064fcc30fe2444dd6: start","job_status":"start","queue_duration_s":0.557603,"scheduling_latency_s":0.557619}2412gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a868350d45cf235a21d84a90a239221281f6ba62/statuses2413gitlab # [ 433.973460] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.534Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"06d3f28064fcc30fe2444dd6","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-06d3f28064fcc30fe2444dd6: done: 0.021466 sec","job_status":"done","queue_duration_s":0.557603,"scheduling_latency_s":0.557619,"redis_calls":15,"redis_duration_s":0.003306,"redis_read_bytes":12,"redis_write_bytes":1464,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000498,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000932,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001876,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013195,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021466,"completed_at":"2026-08-29T13:46:20.534Z","load_balancing_strategy":"primary","db_duration_s":0.000652,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2414gitlab # [ 434.014080] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.536Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"755e7dff1020a9b147493299","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-755e7dff1020a9b147493299: start","job_status":"start","queue_duration_s":0.58109,"scheduling_latency_s":0.581107}2415gitlab # [ 434.025592] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.552Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"755e7dff1020a9b147493299","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-755e7dff1020a9b147493299: done: 0.015622 sec","job_status":"done","queue_duration_s":0.58109,"scheduling_latency_s":0.581107,"redis_calls":13,"redis_duration_s":0.002905,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000959,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001946,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009894,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015622,"completed_at":"2026-08-29T13:46:20.552Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2416gitlab # [ 434.065332] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.553Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9965bfd5b5b0f8e0666bdb99","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9965bfd5b5b0f8e0666bdb99: start","job_status":"start","queue_duration_s":0.598013,"scheduling_latency_s":0.598029}2417gitlab # [ 434.077670] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.569Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9965bfd5b5b0f8e0666bdb99","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9965bfd5b5b0f8e0666bdb99: done: 0.015858 sec","job_status":"done","queue_duration_s":0.598013,"scheduling_latency_s":0.598029,"redis_calls":13,"redis_duration_s":0.003174,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000964,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00221,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009862,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015858,"completed_at":"2026-08-29T13:46:20.569Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2418gitlab # [ 434.117198] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.571Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0dea2ecc53c4f9856b662a93","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0dea2ecc53c4f9856b662a93: start","job_status":"start","queue_duration_s":0.615498,"scheduling_latency_s":0.615513}2419gitlab # [ 434.129480] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.586Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0dea2ecc53c4f9856b662a93","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0dea2ecc53c4f9856b662a93: done: 0.015186 sec","job_status":"done","queue_duration_s":0.615498,"scheduling_latency_s":0.615513,"redis_calls":13,"redis_duration_s":0.002835,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000929,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001906,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009658,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015186,"completed_at":"2026-08-29T13:46:20.586Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2420gitlab # [ 434.168763] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.587Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca96cbad023c941d9b0fe75a","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca96cbad023c941d9b0fe75a: start","job_status":"start","queue_duration_s":0.632022,"scheduling_latency_s":0.632037}2421gitlab # [ 434.181245] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.602Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca96cbad023c941d9b0fe75a","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca96cbad023c941d9b0fe75a: done: 0.015041 sec","job_status":"done","queue_duration_s":0.632022,"scheduling_latency_s":0.632037,"redis_calls":13,"redis_duration_s":0.0029259999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001015,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001911,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00915,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015041,"completed_at":"2026-08-29T13:46:20.602Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2422gitlab # [ 434.220889] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.604Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fffa8db02c2949bc8f41e0b6","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fffa8db02c2949bc8f41e0b6: start","job_status":"start","queue_duration_s":0.648476,"scheduling_latency_s":0.64849}2423gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a868350d45cf235a21d84a90a239221281f6ba62/statuses, in 0.24 seconds)2424gitlab # [ 434.234730] gitaly[896]: time="2026-08-29T13:46:20.993Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M16WAWVA724CP6CYF3A55VM4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-29T13:46:50.390" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:46:20.991" grpc.time_ms=1.613 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2425gitlab # [ 434.247256] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:46:21 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/a868350d45cf235a21d84a90a239221281f6ba62/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1252426gitlab # [ 434.250047] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.619Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fffa8db02c2949bc8f41e0b6","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fffa8db02c2949bc8f41e0b6: done: 0.014754 sec","job_status":"done","queue_duration_s":0.648476,"scheduling_latency_s":0.64849,"redis_calls":13,"redis_duration_s":0.002763,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000942,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001821,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009259,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014754,"completed_at":"2026-08-29T13:46:20.619Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2427gitlab # [ 434.289839] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.620Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"167b5973c0071704cdeceaad","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-167b5973c0071704cdeceaad: start","job_status":"start","queue_duration_s":0.664474,"scheduling_latency_s":0.664489}2428gitlab # [ 434.302451] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.635Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"167b5973c0071704cdeceaad","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-167b5973c0071704cdeceaad: done: 0.015059 sec","job_status":"done","queue_duration_s":0.664474,"scheduling_latency_s":0.664489,"redis_calls":13,"redis_duration_s":0.0027819999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000894,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001888,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009369,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015059,"completed_at":"2026-08-29T13:46:20.635Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2429gitlab # [ 434.342390] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.636Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f2f52e394f1613bb3c993a7","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f2f52e394f1613bb3c993a7: start","job_status":"start","queue_duration_s":0.680972,"scheduling_latency_s":0.680987}2430gitlab # [ 434.354995] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.651Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f2f52e394f1613bb3c993a7","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f2f52e394f1613bb3c993a7: done: 0.014722 sec","job_status":"done","queue_duration_s":0.680972,"scheduling_latency_s":0.680987,"redis_calls":13,"redis_duration_s":0.002611,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000959,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001652,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009376,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014722,"completed_at":"2026-08-29T13:46:20.651Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2431gitlab # [ 434.394432] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.652Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b34101787a6ef6f0e39d404b","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b34101787a6ef6f0e39d404b: start","job_status":"start","queue_duration_s":0.696958,"scheduling_latency_s":0.696973}2432gitlab # [ 434.407071] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.667Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b34101787a6ef6f0e39d404b","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b34101787a6ef6f0e39d404b: done: 0.015168 sec","job_status":"done","queue_duration_s":0.696958,"scheduling_latency_s":0.696973,"redis_calls":13,"redis_duration_s":0.002757,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000926,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001831,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009573,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015168,"completed_at":"2026-08-29T13:46:20.667Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2433gitlab # [ 434.447965] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.669Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f59be84ef969a9bd59bfc375","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f59be84ef969a9bd59bfc375: start","job_status":"start","queue_duration_s":0.713593,"scheduling_latency_s":0.713608}2434gitlab # [ 434.460507] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.684Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f59be84ef969a9bd59bfc375","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f59be84ef969a9bd59bfc375: done: 0.014913 sec","job_status":"done","queue_duration_s":0.713593,"scheduling_latency_s":0.713608,"redis_calls":13,"redis_duration_s":0.002703,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000919,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001784,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009444,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014913,"completed_at":"2026-08-29T13:46:20.684Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2435gitlab # [ 434.500045] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.685Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91b7ff7a17c5d65b5f507da6","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91b7ff7a17c5d65b5f507da6: start","job_status":"start","queue_duration_s":0.730049,"scheduling_latency_s":0.730063}2436gitlab # [ 434.512424] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.700Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91b7ff7a17c5d65b5f507da6","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91b7ff7a17c5d65b5f507da6: done: 0.014722 sec","job_status":"done","queue_duration_s":0.730049,"scheduling_latency_s":0.730063,"redis_calls":13,"redis_duration_s":0.0025830000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000946,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001637,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00942,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014722,"completed_at":"2026-08-29T13:46:20.700Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2437gitlab # [ 434.551537] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.701Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b4d5a21bdd41cd0b08036555","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b4d5a21bdd41cd0b08036555: start","job_status":"start","queue_duration_s":0.746089,"scheduling_latency_s":0.746104}2438gitlab # [ 434.563974] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.716Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b4d5a21bdd41cd0b08036555","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b4d5a21bdd41cd0b08036555: done: 0.014764 sec","job_status":"done","queue_duration_s":0.746089,"scheduling_latency_s":0.746104,"redis_calls":13,"redis_duration_s":0.002772,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000917,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001855,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009279,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014764,"completed_at":"2026-08-29T13:46:20.716Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2439gitlab # [ 434.603406] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.718Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36932573faa8321a66829238","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36932573faa8321a66829238: start","job_status":"start","queue_duration_s":0.762424,"scheduling_latency_s":0.762439}2440gitlab # [ 434.615957] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.733Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36932573faa8321a66829238","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36932573faa8321a66829238: done: 0.015046 sec","job_status":"done","queue_duration_s":0.762424,"scheduling_latency_s":0.762439,"redis_calls":13,"redis_duration_s":0.00284,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000955,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001885,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009426,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015046,"completed_at":"2026-08-29T13:46:20.733Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2441gitlab # [ 434.656367] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.734Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d3c3bd3425b20e0fab39e56","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d3c3bd3425b20e0fab39e56: start","job_status":"start","queue_duration_s":0.778854,"scheduling_latency_s":0.778868}2442gitlab # [ 434.668966] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.749Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d3c3bd3425b20e0fab39e56","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d3c3bd3425b20e0fab39e56: done: 0.014821 sec","job_status":"done","queue_duration_s":0.778854,"scheduling_latency_s":0.778868,"redis_calls":13,"redis_duration_s":0.002757,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000907,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00185,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008948,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014821,"completed_at":"2026-08-29T13:46:20.749Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2443gitlab # [ 434.708127] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.750Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d08e710a9834d49eb0bd0e3","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d08e710a9834d49eb0bd0e3: start","job_status":"start","queue_duration_s":0.79506,"scheduling_latency_s":0.795075}2444gitlab # [ 434.720279] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.766Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d08e710a9834d49eb0bd0e3","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d08e710a9834d49eb0bd0e3: done: 0.015479 sec","job_status":"done","queue_duration_s":0.79506,"scheduling_latency_s":0.795075,"redis_calls":13,"redis_duration_s":0.002847,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001796,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009704,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015479,"completed_at":"2026-08-29T13:46:20.766Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2445gitlab # [ 434.759445] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.767Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"41a13354484e9951f3371bae","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-41a13354484e9951f3371bae: start","job_status":"start","queue_duration_s":0.812022,"scheduling_latency_s":0.812037}2446gitlab # [ 434.772138] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.782Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"41a13354484e9951f3371bae","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-41a13354484e9951f3371bae: done: 0.014921 sec","job_status":"done","queue_duration_s":0.812022,"scheduling_latency_s":0.812037,"redis_calls":13,"redis_duration_s":0.002986,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000936,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00205,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00924,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014921,"completed_at":"2026-08-29T13:46:20.782Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2447gitlab # [ 434.810596] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.784Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3240e462ca6a075c885ac7a2","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3240e462ca6a075c885ac7a2: start","job_status":"start","queue_duration_s":0.828277,"scheduling_latency_s":0.82845}2448gitlab # [ 434.823046] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.798Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3240e462ca6a075c885ac7a2","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3240e462ca6a075c885ac7a2: done: 0.014766 sec","job_status":"done","queue_duration_s":0.828277,"scheduling_latency_s":0.82845,"redis_calls":13,"redis_duration_s":0.002759,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000951,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001808,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009085,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014766,"completed_at":"2026-08-29T13:46:20.798Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2449gitlab # [ 434.863172] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.800Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"675b02f043274b751a528bc9","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-675b02f043274b751a528bc9: start","job_status":"start","queue_duration_s":0.84443,"scheduling_latency_s":0.844444}2450gitlab # [ 434.875476] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.817Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"675b02f043274b751a528bc9","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-675b02f043274b751a528bc9: done: 0.017582 sec","job_status":"done","queue_duration_s":0.84443,"scheduling_latency_s":0.844444,"redis_calls":13,"redis_duration_s":0.002862,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000995,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001867,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009174,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017582,"completed_at":"2026-08-29T13:46:20.817Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2451gitlab # [ 434.914718] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.819Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd40dc1c214d2c36f3951b5e","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd40dc1c214d2c36f3951b5e: start","job_status":"start","queue_duration_s":0.863558,"scheduling_latency_s":0.863573}2452gitlab # [ 434.927142] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.834Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd40dc1c214d2c36f3951b5e","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd40dc1c214d2c36f3951b5e: done: 0.014685 sec","job_status":"done","queue_duration_s":0.863558,"scheduling_latency_s":0.863573,"redis_calls":13,"redis_duration_s":0.002764,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00095,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001814,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009118,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014685,"completed_at":"2026-08-29T13:46:20.834Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2453gitlab # [ 434.966267] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.835Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"85bc451f0f85dc80cbcda7fa","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-85bc451f0f85dc80cbcda7fa: start","job_status":"start","queue_duration_s":0.8795,"scheduling_latency_s":0.879515}2454gitlab # [ 434.978760] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.850Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"85bc451f0f85dc80cbcda7fa","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-85bc451f0f85dc80cbcda7fa: done: 0.015028 sec","job_status":"done","queue_duration_s":0.8795,"scheduling_latency_s":0.879515,"redis_calls":13,"redis_duration_s":0.002689,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000942,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001747,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009379,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015028,"completed_at":"2026-08-29T13:46:20.850Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2455gitlab # [ 435.017661] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.851Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c677df660b70893653836290","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c677df660b70893653836290: start","job_status":"start","queue_duration_s":0.895853,"scheduling_latency_s":0.895868}2456gitlab # [ 435.029779] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.868Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c677df660b70893653836290","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c677df660b70893653836290: done: 0.016631 sec","job_status":"done","queue_duration_s":0.895853,"scheduling_latency_s":0.895868,"redis_calls":13,"redis_duration_s":0.002288,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00079,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001498,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010966,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016631,"completed_at":"2026-08-29T13:46:20.868Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2457gitlab # [ 435.070122] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.870Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"931cde735e57d28b1f03981e","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-931cde735e57d28b1f03981e: start","job_status":"start","queue_duration_s":0.91429,"scheduling_latency_s":0.914306}2458gitlab # [ 435.082676] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.885Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"931cde735e57d28b1f03981e","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-931cde735e57d28b1f03981e: done: 0.015259 sec","job_status":"done","queue_duration_s":0.91429,"scheduling_latency_s":0.914306,"redis_calls":13,"redis_duration_s":0.002238,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000834,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001404,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01044,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015259,"completed_at":"2026-08-29T13:46:20.885Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2459gitlab # [ 435.121734] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.886Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1d9f436c09ba0d46a83bfd82","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1d9f436c09ba0d46a83bfd82: start","job_status":"start","queue_duration_s":0.930598,"scheduling_latency_s":0.930613}2460gitlab # [ 435.133808] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.903Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1d9f436c09ba0d46a83bfd82","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1d9f436c09ba0d46a83bfd82: done: 0.016874 sec","job_status":"done","queue_duration_s":0.930598,"scheduling_latency_s":0.930613,"redis_calls":13,"redis_duration_s":0.0016870000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000666,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001021,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012007,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016874,"completed_at":"2026-08-29T13:46:20.903Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2461gitlab # [ 435.172778] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.904Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3cf7fdce23aac26b33fe47c","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3cf7fdce23aac26b33fe47c: start","job_status":"start","queue_duration_s":0.948565,"scheduling_latency_s":0.948581}2462gitlab # [ 435.185268] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.919Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3cf7fdce23aac26b33fe47c","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3cf7fdce23aac26b33fe47c: done: 0.015482 sec","job_status":"done","queue_duration_s":0.948565,"scheduling_latency_s":0.948581,"redis_calls":13,"redis_duration_s":0.001639,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000564,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001075,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011083,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015482,"completed_at":"2026-08-29T13:46:20.919Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2463gitlab # [ 435.224128] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.921Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6677f3362fc4ca4e59973fef","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6677f3362fc4ca4e59973fef: start","job_status":"start","queue_duration_s":0.965136,"scheduling_latency_s":0.965403}2464gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a868350d45cf235a21d84a90a239221281f6ba62/statuses2465gitlab # [ 435.236423] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.937Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6677f3362fc4ca4e59973fef","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6677f3362fc4ca4e59973fef: done: 0.016811 sec","job_status":"done","queue_duration_s":0.965136,"scheduling_latency_s":0.965403,"redis_calls":13,"redis_duration_s":0.001453,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000533,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00092,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009847,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016811,"completed_at":"2026-08-29T13:46:20.937Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2466gitlab # [ 435.273809] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.938Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d5c2975336c843f7cfdb66e9","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d5c2975336c843f7cfdb66e9: start","job_status":"start","queue_duration_s":0.982998,"scheduling_latency_s":0.983014}2467gitlab # [ 435.285393] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.952Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d5c2975336c843f7cfdb66e9","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d5c2975336c843f7cfdb66e9: done: 0.013962 sec","job_status":"done","queue_duration_s":0.982998,"scheduling_latency_s":0.983014,"redis_calls":13,"redis_duration_s":0.0013930000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000883,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0097,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013962,"completed_at":"2026-08-29T13:46:20.952Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2468gitlab # [ 435.324435] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.954Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e11b34cd76953b13b8d14d4","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e11b34cd76953b13b8d14d4: start","job_status":"start","queue_duration_s":0.998239,"scheduling_latency_s":0.998256}2469gitlab # [ 435.336677] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.968Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e11b34cd76953b13b8d14d4","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e11b34cd76953b13b8d14d4: done: 0.014241 sec","job_status":"done","queue_duration_s":0.998239,"scheduling_latency_s":0.998256,"redis_calls":13,"redis_duration_s":0.0014190000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000909,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009921,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014241,"completed_at":"2026-08-29T13:46:20.968Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2470gitlab # [ 435.375908] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.969Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d2aee8a53025f42205c9ef1","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d2aee8a53025f42205c9ef1: start","job_status":"start","queue_duration_s":1.013883,"scheduling_latency_s":1.013901}2471gitlab # [ 435.388430] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.983Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d2aee8a53025f42205c9ef1","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d2aee8a53025f42205c9ef1: done: 0.014252 sec","job_status":"done","queue_duration_s":1.013883,"scheduling_latency_s":1.013901,"redis_calls":13,"redis_duration_s":0.001412,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000495,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000917,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009777,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014252,"completed_at":"2026-08-29T13:46:20.983Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2472gitlab # [ 435.427095] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:20.985Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be920f7955c2b38a9c8d7bb5","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be920f7955c2b38a9c8d7bb5: start","job_status":"start","queue_duration_s":1.029502,"scheduling_latency_s":1.029522}2473gitlab # [ 435.440195] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:21.000Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be920f7955c2b38a9c8d7bb5","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be920f7955c2b38a9c8d7bb5: done: 0.01482 sec","job_status":"done","queue_duration_s":1.029502,"scheduling_latency_s":1.029522,"redis_calls":13,"redis_duration_s":0.001528,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000989,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010188,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01482,"completed_at":"2026-08-29T13:46:21.000Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2474gitlab # [ 435.479776] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:21.001Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6341ae205cc6f26d99183936","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6341ae205cc6f26d99183936: start","job_status":"start","queue_duration_s":1.045846,"scheduling_latency_s":1.045869}2475gitlab # [ 435.493729] gitaly[896]: time="2026-08-29T13:46:22.244Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M16WAY1TRSPMJ1744PEYXBTH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-29T13:46:52.242" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:46:22.243" grpc.time_ms=1.322 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2476gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a868350d45cf235a21d84a90a239221281f6ba62/statuses, in 0.27 seconds)2477gitlab # [ 435.506664] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:21.017Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6341ae205cc6f26d99183936","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6341ae205cc6f26d99183936: done: 0.015565 sec","job_status":"done","queue_duration_s":1.045846,"scheduling_latency_s":1.045869,"redis_calls":13,"redis_duration_s":0.0014290000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000912,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010807,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015565,"completed_at":"2026-08-29T13:46:21.017Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2478gitlab # [ 435.545826] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:21.018Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a02b7b1ea67f50a5c1588c8e","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a02b7b1ea67f50a5c1588c8e: start","job_status":"start","queue_duration_s":1.062861,"scheduling_latency_s":1.062885}2479gitlab # [ 435.558684] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:46:22 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/a868350d45cf235a21d84a90a239221281f6ba62/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1632480gitlab # [ 435.561416] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:21.034Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a02b7b1ea67f50a5c1588c8e","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a02b7b1ea67f50a5c1588c8e: done: 0.015435 sec","job_status":"done","queue_duration_s":1.062861,"scheduling_latency_s":1.062885,"redis_calls":13,"redis_duration_s":0.0017139999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000797,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000917,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010534,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015435,"completed_at":"2026-08-29T13:46:21.034Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2481gitlab # [ 435.600921] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:21.035Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e83d9faf818070078557345","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e83d9faf818070078557345: start","job_status":"start","queue_duration_s":1.079454,"scheduling_latency_s":1.079478}2482gitlab # [ 435.613152] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:21.051Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e83d9faf818070078557345","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e83d9faf818070078557345: done: 0.016553 sec","job_status":"done","queue_duration_s":1.079454,"scheduling_latency_s":1.079478,"redis_calls":13,"redis_duration_s":0.002461,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000849,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001612,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010444,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016553,"completed_at":"2026-08-29T13:46:21.051Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2483gitlab # [ 435.652600] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:21.053Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8de64af75e188aec9f474758","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8de64af75e188aec9f474758: start","job_status":"start","queue_duration_s":1.097517,"scheduling_latency_s":1.097541}2484gitlab # [ 435.665012] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:21.071Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8de64af75e188aec9f474758","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8de64af75e188aec9f474758: done: 0.018213 sec","job_status":"done","queue_duration_s":1.097517,"scheduling_latency_s":1.097541,"redis_calls":13,"redis_duration_s":0.00344,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000945,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002495,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010715,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018213,"completed_at":"2026-08-29T13:46:21.071Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2485gitlab # [ 435.705381] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:21.073Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"231abfc077917a4418e05928","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-231abfc077917a4418e05928: start","job_status":"start","queue_duration_s":1.117566,"scheduling_latency_s":1.117596}2486gitlab # [ 435.717887] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:21.092Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"231abfc077917a4418e05928","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-231abfc077917a4418e05928: done: 0.019173 sec","job_status":"done","queue_duration_s":1.117566,"scheduling_latency_s":1.117596,"redis_calls":13,"redis_duration_s":0.002882,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001021,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001861,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011555,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019173,"completed_at":"2026-08-29T13:46:21.092Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2487gitlab # [ 435.757351] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:21.094Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b24388166e1cd0c1d0b388f","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b24388166e1cd0c1d0b388f: start","job_status":"start","queue_duration_s":1.138524,"scheduling_latency_s":1.138549}2488gitlab # [ 435.769788] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:21.113Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b24388166e1cd0c1d0b388f","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b24388166e1cd0c1d0b388f: done: 0.019597 sec","job_status":"done","queue_duration_s":1.138524,"scheduling_latency_s":1.138549,"redis_calls":13,"redis_duration_s":0.003013,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000981,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002032,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010476,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019597,"completed_at":"2026-08-29T13:46:21.113Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2489gitlab # [ 435.808981] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:21.115Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4974550601410bd333d4f6b","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4974550601410bd333d4f6b: start","job_status":"start","queue_duration_s":1.159748,"scheduling_latency_s":1.159774}2490gitlab # [ 435.821539] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:21.132Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4974550601410bd333d4f6b","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4974550601410bd333d4f6b: done: 0.017129 sec","job_status":"done","queue_duration_s":1.159748,"scheduling_latency_s":1.159774,"redis_calls":13,"redis_duration_s":0.002624,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000927,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001697,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010201,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017129,"completed_at":"2026-08-29T13:46:21.132Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2491gitlab # [ 435.860636] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:21.134Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5cef3becc1c9ffb88299a943","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5cef3becc1c9ffb88299a943: start","job_status":"start","queue_duration_s":1.178459,"scheduling_latency_s":1.178483}2492gitlab # [ 435.873913] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:21.151Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5cef3becc1c9ffb88299a943","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5cef3becc1c9ffb88299a943: done: 0.016892 sec","job_status":"done","queue_duration_s":1.178459,"scheduling_latency_s":1.178483,"redis_calls":13,"redis_duration_s":0.0029560000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001039,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001917,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010087,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016892,"completed_at":"2026-08-29T13:46:21.151Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2493gitlab # [ 435.914820] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:21.153Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f078d6ef8702de6c601b9d3c","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f078d6ef8702de6c601b9d3c: start","job_status":"start","queue_duration_s":1.197389,"scheduling_latency_s":1.197416}2494gitlab # [ 435.927453] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:21.170Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f078d6ef8702de6c601b9d3c","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f078d6ef8702de6c601b9d3c: done: 0.017186 sec","job_status":"done","queue_duration_s":1.197389,"scheduling_latency_s":1.197416,"redis_calls":13,"redis_duration_s":0.002845,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000934,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001911,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010335,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017186,"completed_at":"2026-08-29T13:46:21.170Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2495gitlab # [ 435.967244] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:21.172Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a44b5d31a844143ce0cb5ac1","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a44b5d31a844143ce0cb5ac1: start","job_status":"start","queue_duration_s":1.216789,"scheduling_latency_s":1.216816}2496gitlab # [ 435.979972] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:21.189Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a44b5d31a844143ce0cb5ac1","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a44b5d31a844143ce0cb5ac1: done: 0.016994 sec","job_status":"done","queue_duration_s":1.216789,"scheduling_latency_s":1.216816,"redis_calls":13,"redis_duration_s":0.002789,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000937,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001852,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01054,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016994,"completed_at":"2026-08-29T13:46:21.189Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2497gitlab # [ 436.019810] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:21.191Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a0ed58bcb145ee672929e17","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a0ed58bcb145ee672929e17: start","job_status":"start","queue_duration_s":1.235683,"scheduling_latency_s":1.235712}2498gitlab # [ 436.032211] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:21.208Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a0ed58bcb145ee672929e17","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a0ed58bcb145ee672929e17: done: 0.017489 sec","job_status":"done","queue_duration_s":1.235683,"scheduling_latency_s":1.235712,"redis_calls":13,"redis_duration_s":0.0028599999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000957,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001903,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010991,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017489,"completed_at":"2026-08-29T13:46:21.208Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2499gitlab # [ 436.072038] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:21.210Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3936f2dd2df747733bdbab1","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3936f2dd2df747733bdbab1: start","job_status":"start","queue_duration_s":1.255013,"scheduling_latency_s":1.255038}2500gitlab # [ 436.084543] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:21.226Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3936f2dd2df747733bdbab1","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3936f2dd2df747733bdbab1: done: 0.016172 sec","job_status":"done","queue_duration_s":1.255013,"scheduling_latency_s":1.255038,"redis_calls":13,"redis_duration_s":0.0025960000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000954,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001642,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010464,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016172,"completed_at":"2026-08-29T13:46:21.226Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2501gitlab # [ 436.125183] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:21.228Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5769219b3cce762a307e5a66","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5769219b3cce762a307e5a66: start","job_status":"start","queue_duration_s":1.272865,"scheduling_latency_s":1.272889}2502gitlab # [ 436.137641] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:21.244Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5769219b3cce762a307e5a66","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5769219b3cce762a307e5a66: done: 0.015679 sec","job_status":"done","queue_duration_s":1.272865,"scheduling_latency_s":1.272889,"redis_calls":13,"redis_duration_s":0.0025080000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000921,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001587,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009897,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015679,"completed_at":"2026-08-29T13:46:21.244Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2503gitlab # [ 436.177229] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:21.245Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dbb559a9ad715bff7a7b922c","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dbb559a9ad715bff7a7b922c: start","job_status":"start","queue_duration_s":1.289896,"scheduling_latency_s":1.289919}2504gitlab # [ 436.189483] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:21.261Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dbb559a9ad715bff7a7b922c","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dbb559a9ad715bff7a7b922c: done: 0.015376 sec","job_status":"done","queue_duration_s":1.289896,"scheduling_latency_s":1.289919,"redis_calls":13,"redis_duration_s":0.002794,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000927,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001867,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009439,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015376,"completed_at":"2026-08-29T13:46:21.261Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2505gitlab # [ 436.228666] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:21.262Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20c539f7eaf0977f87f086be","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20c539f7eaf0977f87f086be: start","job_status":"start","queue_duration_s":1.306708,"scheduling_latency_s":1.306731}2506gitlab # [ 436.241076] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:21.278Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20c539f7eaf0977f87f086be","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20c539f7eaf0977f87f086be: done: 0.016292 sec","job_status":"done","queue_duration_s":1.306708,"scheduling_latency_s":1.306731,"redis_calls":13,"redis_duration_s":0.00355,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000987,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002563,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009721,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016292,"completed_at":"2026-08-29T13:46:21.278Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2507gitlab # [ 436.280603] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:21.280Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d70ec9b14d9f1fa639b83fa","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d70ec9b14d9f1fa639b83fa: start","job_status":"start","queue_duration_s":1.324432,"scheduling_latency_s":1.324457}2508gitlab # [ 436.292868] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:21.295Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d70ec9b14d9f1fa639b83fa","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d70ec9b14d9f1fa639b83fa: done: 0.015275 sec","job_status":"done","queue_duration_s":1.324432,"scheduling_latency_s":1.324457,"redis_calls":13,"redis_duration_s":0.002859,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000934,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001925,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00929,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015275,"completed_at":"2026-08-29T13:46:21.295Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2509gitlab # [ 436.333620] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:21.297Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2d71f2062c203e535e9e5ee7","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2d71f2062c203e535e9e5ee7: start","job_status":"start","queue_duration_s":1.341165,"scheduling_latency_s":1.341187}2510gitlab # [ 436.346169] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:21.313Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2d71f2062c203e535e9e5ee7","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2d71f2062c203e535e9e5ee7: done: 0.016817 sec","job_status":"done","queue_duration_s":1.341165,"scheduling_latency_s":1.341187,"redis_calls":13,"redis_duration_s":0.004063,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000952,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003111,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009748,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016817,"completed_at":"2026-08-29T13:46:21.313Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2511gitlab # [ 436.385285] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:21.315Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"101cddcd5f6345e81e26b0f6","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-101cddcd5f6345e81e26b0f6: start","job_status":"start","queue_duration_s":1.359382,"scheduling_latency_s":1.359409}2512gitlab # [ 436.397725] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:21.330Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"101cddcd5f6345e81e26b0f6","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-101cddcd5f6345e81e26b0f6: done: 0.01501 sec","job_status":"done","queue_duration_s":1.359382,"scheduling_latency_s":1.359409,"redis_calls":13,"redis_duration_s":0.002709,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000901,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001808,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009161,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01501,"completed_at":"2026-08-29T13:46:21.330Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2513gitlab # [ 436.437188] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:21.331Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b9480422345feb6dd5aefd4d","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b9480422345feb6dd5aefd4d: start","job_status":"start","queue_duration_s":1.375753,"scheduling_latency_s":1.375774}2514gitlab # [ 436.449636] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:21.346Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b9480422345feb6dd5aefd4d","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b9480422345feb6dd5aefd4d: done: 0.014734 sec","job_status":"done","queue_duration_s":1.375753,"scheduling_latency_s":1.375774,"redis_calls":13,"redis_duration_s":0.002561,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000912,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001649,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009095,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014734,"completed_at":"2026-08-29T13:46:21.346Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2515gitlab # [ 436.488671] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:21.347Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4dc52fc2ffef706531e40209","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4dc52fc2ffef706531e40209: start","job_status":"start","queue_duration_s":1.391871,"scheduling_latency_s":1.391895}2516gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a868350d45cf235a21d84a90a239221281f6ba62/statuses2517gitlab # [ 436.501088] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:21.362Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4dc52fc2ffef706531e40209","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4dc52fc2ffef706531e40209: done: 0.015015 sec","job_status":"done","queue_duration_s":1.391871,"scheduling_latency_s":1.391895,"redis_calls":13,"redis_duration_s":0.002638,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000937,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001701,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009231,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015015,"completed_at":"2026-08-29T13:46:21.362Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2518gitlab # [ 436.539390] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:21.364Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28a6302fa608b582613cf4a8","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28a6302fa608b582613cf4a8: start","job_status":"start","queue_duration_s":1.408276,"scheduling_latency_s":1.408299}2519gitlab # [ 436.550958] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:21.379Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28a6302fa608b582613cf4a8","created_at":"2026-08-29T13:46:19.771Z","trace_propagation_headers":{"sentry-trace":"c97615178f60427489752df765f97638-bf89baa5468e4887","baggage":"sentry-trace_id=c97615178f60427489752df765f97638,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"779768bbc9d542bb969e4d0128c90272","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-29T13:46:19.955Z","job_size_bytes":2,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28a6302fa608b582613cf4a8: done: 0.015756 sec","job_status":"done","queue_duration_s":1.408276,"scheduling_latency_s":1.408299,"redis_calls":13,"redis_duration_s":0.003272,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000961,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002311,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009499,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015756,"completed_at":"2026-08-29T13:46:21.379Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2520gitlab # [ 436.758772] gitaly[896]: time="2026-08-29T13:46:23.562Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M16WAZA51N56MMBPF7NASP6D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-29T13:46:53.060" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:46:23.560" grpc.time_ms=1.378 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2521gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a868350d45cf235a21d84a90a239221281f6ba62/statuses, in 0.32 seconds)2522gitlab # [ 436.827091] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:46:23 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/a868350d45cf235a21d84a90a239221281f6ba62/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 2012523gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a868350d45cf235a21d84a90a239221281f6ba62/statuses2524gitlab # [ 437.840462] nix-daemon[3777]: accepted connection from pid 4426, user nixbot2525gitlab # [ 438.000341] gitaly[896]: time="2026-08-29T13:46:24.804Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M16WB0HY5TCF7A6C3J2A89BG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-29T13:46:54.301" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:46:24.802" grpc.time_ms=1.39 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2526gitlab # [ 438.033411] gitaly[896]: time="2026-08-29T13:46:24.833Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M16WB0JKPAFFN5HA9WGP5W3J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-29T13:46:54.831" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:46:24.832" grpc.time_ms=0.989 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2527gitlab # [ 438.068956] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:46:24 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/a868350d45cf235a21d84a90a239221281f6ba62/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1692528gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a868350d45cf235a21d84a90a239221281f6ba62/statuses, in 0.24 seconds)2529gitlab # [ 438.124730] gitaly[896]: time="2026-08-29T13:46:24.929Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=0 command.user_time_ms=14 component=gitaly.StreamServerInterceptor correlation_id=01M16WB0JKPAFFN5HA9WGP5W3J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-29T13:46:34.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-29T13:46:24.911" grpc.time_ms=17.733 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2530gitlab # [ 438.240594] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:25.043Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"11cbbc4ecb7aeef57e3bcc5b","created_at":"2026-08-29T13:46:25.035Z","trace_propagation_headers":{"sentry-trace":"96697051ffd24f43b1e88f5da86df310-c067b97c14f5473b","baggage":"sentry-trace_id=96697051ffd24f43b1e88f5da86df310,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M16WB0JKPAFFN5HA9WGP5W3J","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:25.041Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-11cbbc4ecb7aeef57e3bcc5b: start","job_status":"start","queue_duration_s":0.002256,"scheduling_latency_s":0.002311}2531gitlab # [ 438.288653] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:46:25 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 3512532gitlab # [ 438.295804] nixbot[3547]: {"ts": "2026-08-29T13:46:25.077Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a868350d45cf235a21d84a90a239221281f6ba62 \"HTTP/1.1 201 Created\""}2533gitlab # [ 438.407050] gitaly[896]: time="2026-08-29T13:46:25.211Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M16WB0XYPP9FTS0WBKGZAC3E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-29T13:46:55.109" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:46:25.210" grpc.time_ms=1.052 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2534gitlab # [ 438.443430] gitaly[896]: time="2026-08-29T13:46:25.243Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M16WB0JKPAFFN5HA9WGP5W3J grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3895 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-29T13:46:25.243" grpc.time_ms=0.708 pid=896 span.kind=server system=grpc2535gitlab # [ 438.492235] gitaly[896]: time="2026-08-29T13:46:25.294Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M16WB0JKPAFFN5HA9WGP5W3J grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-29T13:46:25.293" grpc.time_ms=0.731 pid=896 span.kind=server system=grpc2536gitlab # [ 438.517068] gitaly[896]: time="2026-08-29T13:46:25.304Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=1 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M16WB0XYPP9FTS0WBKGZAC3E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-29T13:46:35.053" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-29T13:46:25.284" grpc.time_ms=20.487 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2537gitlab # [ 438.540641] gitaly[896]: time="2026-08-29T13:46:25.343Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M16WB0JKPAFFN5HA9WGP5W3J grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3895 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-29T13:46:25.341" grpc.time_ms=0.842 pid=896 span.kind=server system=grpc2538gitlab # [ 438.558803] gitaly[896]: time="2026-08-29T13:46:25.347Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M16WB0JKPAFFN5HA9WGP5W3J forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-29T13:46:55.079" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-29T13:46:25.180" operations="[repack_refs]" pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2539gitlab # [ 438.578008] gitaly[896]: time="2026-08-29T13:46:25.351Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M16WB0JKPAFFN5HA9WGP5W3J grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-29T13:46:55.079" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-29T13:46:25.180" pid=896 remote_ip="2001:db8:1::1" repository_info="{false {6 703 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-08-29 13:44:35.89252648 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2540gitlab # [ 438.597581] gitaly[896]: time="2026-08-29T13:46:25.353Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M16WB0JKPAFFN5HA9WGP5W3J diskcache=84e7ed95-23cc-4946-830d-48d5d58b864c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-29T13:46:55.079" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-29T13:46:25.180" pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2541gitlab # [ 438.612426] gitaly[896]: time="2026-08-29T13:46:25.354Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=172 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7433 command.oublock=0 command.real_time_ms=165 command.spawn_token_fork_ms=1 command.system_time_ms=96 command.user_time_ms=76 component=gitaly.UnaryServerInterceptor correlation_id=01M16WB0JKPAFFN5HA9WGP5W3J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-29T13:46:55.079" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-29T13:46:25.180" grpc.time_ms=174.202 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2542gitlab # [ 438.629406] nixbot[3547]: {"ts": "2026-08-29T13:46:25.391Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a868350d45cf235a21d84a90a239221281f6ba62 \"HTTP/1.1 201 Created\""}2543gitlab # [ 438.632766] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:46:25 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 3032544gitlab # [ 438.635724] gitaly[896]: time="2026-08-29T13:46:25.385Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M16WB0JKPAFFN5HA9WGP5W3J grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-29T13:46:55.079" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-29T13:46:25.180" pid=896 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2545gitlab # [ 438.650572] gitaly[896]: time="2026-08-29T13:46:25.385Z" level=info msg="optimized repository" clean_stale_data_time=34.14456ms clean_work_trees_time="118.02µs" commit_graph_time=640ns correlation_id=01M16WB0JKPAFFN5HA9WGP5W3J gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="2.12µs" pid=896 prune_time=440ns relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="1.64µs" storage_name=default system=housekeeping total_time=34.29396ms2546gitlab # [ 438.656830] gitaly[896]: time="2026-08-29T13:46:25.385Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M16WB0JKPAFFN5HA9WGP5W3J grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-29T13:46:55.079" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-29T13:46:25.180" pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2547gitlab # [ 438.676601] gitaly[896]: time="2026-08-29T13:46:25.481Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M16WB0JKPAFFN5HA9WGP5W3J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-29T13:46:55.379" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:46:25.479" grpc.time_ms=1.259 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2548gitlab # [ 438.695691] gitaly[896]: time="2026-08-29T13:46:25.485Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M16WB17TRJH2K5ENXFG9HVWS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-29T13:46:55.483" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:46:25.484" grpc.time_ms=0.585 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2549gitlab # [ 438.731641] gitaly[896]: time="2026-08-29T13:46:25.536Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M16WB0JKPAFFN5HA9WGP5W3J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-29T13:46:55.434" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-29T13:46:25.535" grpc.time_ms=0.907 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2550gitlab # [ 438.751807] gitaly[896]: time="2026-08-29T13:46:25.553Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M16WB17TRJH2K5ENXFG9HVWS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-29T13:46:35.149" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-29T13:46:25.540" grpc.time_ms=13.473 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2551gitlab # [ 438.769891] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:25.555Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"e2f76492de417f5c81584b46","created_at":"2026-08-29T13:46:25.553Z","trace_propagation_headers":{"sentry-trace":"96697051ffd24f43b1e88f5da86df310-b85279b18b6e455c","baggage":"sentry-trace_id=96697051ffd24f43b1e88f5da86df310,sentry-release=Unknown"},"correlation_id":"01M16WB0JKPAFFN5HA9WGP5W3J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"11cbbc4ecb7aeef57e3bcc5b","job_size_bytes":3,"pid":3497,"job_status":"deduplicated","message":"PipelineProcessWorker JID-e2f76492de417f5c81584b46: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2552gitlab # [ 438.789457] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:25.558Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"11cbbc4ecb7aeef57e3bcc5b","created_at":"2026-08-29T13:46:25.035Z","trace_propagation_headers":{"sentry-trace":"96697051ffd24f43b1e88f5da86df310-c067b97c14f5473b","baggage":"sentry-trace_id=96697051ffd24f43b1e88f5da86df310,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M16WB0JKPAFFN5HA9WGP5W3J","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:25.041Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3497,"job_status":"rescheduled","message":"PipelineProcessWorker JID-11cbbc4ecb7aeef57e3bcc5b: rescheduled"}2553gitlab # [ 438.806847] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:25.569Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"11cbbc4ecb7aeef57e3bcc5b","created_at":"2026-08-29T13:46:25.035Z","trace_propagation_headers":{"sentry-trace":"96697051ffd24f43b1e88f5da86df310-c067b97c14f5473b","baggage":"sentry-trace_id=96697051ffd24f43b1e88f5da86df310,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M16WB0JKPAFFN5HA9WGP5W3J","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:25.041Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-11cbbc4ecb7aeef57e3bcc5b: done: 0.526342 sec","job_status":"done","queue_duration_s":0.002256,"scheduling_latency_s":0.002311,"gitaly_calls":3,"gitaly_duration_s":0.185751,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.03923,"redis_read_bytes":239,"redis_write_bytes":21782,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001826,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001847,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.011805,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14467,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.018462,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000468,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000727,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002269,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.063,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.011,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.014,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.03,"db_ci_duration_s":0.033,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.252964,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.4448733,"duration_s":0.526342,"completed_at":"2026-08-29T13:46:25.569Z","load_balancing_strategy":"primary","db_duration_s":0.064692,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2554gitlab # [ 438.861228] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:25.572Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"00b7f5f8f37043ca9f7f4e9d","created_at":"2026-08-29T13:46:25.168Z","trace_propagation_headers":{"sentry-trace":"96697051ffd24f43b1e88f5da86df310-b85279b18b6e455c","baggage":"sentry-trace_id=96697051ffd24f43b1e88f5da86df310,sentry-release=Unknown"},"correlation_id":"01M16WB0JKPAFFN5HA9WGP5W3J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:25.171Z","job_size_bytes":23,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-00b7f5f8f37043ca9f7f4e9d: start","job_status":"start","queue_duration_s":0.400301,"scheduling_latency_s":0.400328}2555gitlab # [ 438.877937] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:25.631Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"00b7f5f8f37043ca9f7f4e9d","created_at":"2026-08-29T13:46:25.168Z","trace_propagation_headers":{"sentry-trace":"96697051ffd24f43b1e88f5da86df310-b85279b18b6e455c","baggage":"sentry-trace_id=96697051ffd24f43b1e88f5da86df310,sentry-release=Unknown"},"correlation_id":"01M16WB0JKPAFFN5HA9WGP5W3J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:25.171Z","job_size_bytes":23,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-00b7f5f8f37043ca9f7f4e9d: done: 0.059517 sec","job_status":"done","queue_duration_s":0.400301,"scheduling_latency_s":0.400328,"redis_calls":7,"redis_duration_s":0.002071,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001451,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00062,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043087,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.059517,"completed_at":"2026-08-29T13:46:25.631Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01198,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2556gitlab # [ 438.920906] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:25.633Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"6f2f10a3dd32b6a038b33bf5","created_at":"2026-08-29T13:46:25.363Z","trace_propagation_headers":{"sentry-trace":"96697051ffd24f43b1e88f5da86df310-b85279b18b6e455c","baggage":"sentry-trace_id=96697051ffd24f43b1e88f5da86df310,sentry-release=Unknown"},"correlation_id":"01M16WB0JKPAFFN5HA9WGP5W3J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:25.372Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-6f2f10a3dd32b6a038b33bf5: start","job_status":"start","queue_duration_s":0.260933,"scheduling_latency_s":0.260956}2557gitlab # [ 438.937450] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:46:25 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a868350d45cf235a21d84a90a239221281f6ba62 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2512558gitlab # [ 438.939870] nixbot[3547]: {"ts": "2026-08-29T13:46:25.655Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a868350d45cf235a21d84a90a239221281f6ba62 \"HTTP/1.1 201 Created\""}2559gitlab # [ 438.942885] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:25.673Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"6f2f10a3dd32b6a038b33bf5","created_at":"2026-08-29T13:46:25.363Z","trace_propagation_headers":{"sentry-trace":"96697051ffd24f43b1e88f5da86df310-b85279b18b6e455c","baggage":"sentry-trace_id=96697051ffd24f43b1e88f5da86df310,sentry-release=Unknown"},"correlation_id":"01M16WB0JKPAFFN5HA9WGP5W3J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:25.372Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-6f2f10a3dd32b6a038b33bf5: done: 0.040156 sec","job_status":"done","queue_duration_s":0.260933,"scheduling_latency_s":0.260956,"redis_calls":7,"redis_duration_s":0.002277,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001702,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000575,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024041,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.040156,"completed_at":"2026-08-29T13:46:25.673Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010613,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2560gitlab # [ 438.987626] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:25.678Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"18309bfca82bc4ac6e9cc995","created_at":"2026-08-29T13:46:25.388Z","trace_propagation_headers":{"sentry-trace":"96697051ffd24f43b1e88f5da86df310-b85279b18b6e455c","baggage":"sentry-trace_id=96697051ffd24f43b1e88f5da86df310,sentry-release=Unknown"},"correlation_id":"01M16WB0JKPAFFN5HA9WGP5W3J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:25.394Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-18309bfca82bc4ac6e9cc995: start","job_status":"start","queue_duration_s":0.284088,"scheduling_latency_s":0.28411}2561gitlab # [ 439.003851] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:25.722Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"18309bfca82bc4ac6e9cc995","created_at":"2026-08-29T13:46:25.388Z","trace_propagation_headers":{"sentry-trace":"96697051ffd24f43b1e88f5da86df310-b85279b18b6e455c","baggage":"sentry-trace_id=96697051ffd24f43b1e88f5da86df310,sentry-release=Unknown"},"correlation_id":"01M16WB0JKPAFFN5HA9WGP5W3J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:25.394Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-18309bfca82bc4ac6e9cc995: done: 0.044188 sec","job_status":"done","queue_duration_s":0.284088,"scheduling_latency_s":0.28411,"redis_calls":7,"redis_duration_s":0.0027429999999999998,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002147,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000596,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025841,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.044188,"completed_at":"2026-08-29T13:46:25.722Z","load_balancing_strategy":"primary","db_duration_s":0.011902,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2562gitlab # [ 439.046628] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:25.727Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"707b8e4593ce3d8f8227ae00","created_at":"2026-08-29T13:46:25.408Z","trace_propagation_headers":{"sentry-trace":"96697051ffd24f43b1e88f5da86df310-b85279b18b6e455c","baggage":"sentry-trace_id=96697051ffd24f43b1e88f5da86df310,sentry-release=Unknown"},"correlation_id":"01M16WB0JKPAFFN5HA9WGP5W3J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:25.412Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-707b8e4593ce3d8f8227ae00: start","job_status":"start","queue_duration_s":0.314934,"scheduling_latency_s":0.314981}2563gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a868350d45cf235a21d84a90a239221281f6ba62/statuses2564gitlab # [ 439.062420] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:25.822Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"707b8e4593ce3d8f8227ae00","created_at":"2026-08-29T13:46:25.408Z","trace_propagation_headers":{"sentry-trace":"96697051ffd24f43b1e88f5da86df310-b85279b18b6e455c","baggage":"sentry-trace_id=96697051ffd24f43b1e88f5da86df310,sentry-release=Unknown"},"correlation_id":"01M16WB0JKPAFFN5HA9WGP5W3J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:25.412Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-707b8e4593ce3d8f8227ae00: done: 0.095051 sec","job_status":"done","queue_duration_s":0.314934,"scheduling_latency_s":0.314981,"redis_calls":10,"redis_duration_s":0.012561,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002805,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.009033,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000723,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.066293,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.095051,"completed_at":"2026-08-29T13:46:25.821Z","load_balancing_strategy":"primary","db_duration_s":0.009614,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2565gitlab # [ 439.104385] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:25.827Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"e867059205a5b0e544ee9103","created_at":"2026-08-29T13:46:25.413Z","trace_propagation_headers":{"sentry-trace":"96697051ffd24f43b1e88f5da86df310-b85279b18b6e455c","baggage":"sentry-trace_id=96697051ffd24f43b1e88f5da86df310,sentry-release=Unknown"},"correlation_id":"01M16WB0JKPAFFN5HA9WGP5W3J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:25.418Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-e867059205a5b0e544ee9103: start","job_status":"start","queue_duration_s":0.40819,"scheduling_latency_s":0.408244}2566gitlab # [ 439.121127] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:25.895Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"e867059205a5b0e544ee9103","created_at":"2026-08-29T13:46:25.413Z","trace_propagation_headers":{"sentry-trace":"96697051ffd24f43b1e88f5da86df310-b85279b18b6e455c","baggage":"sentry-trace_id=96697051ffd24f43b1e88f5da86df310,sentry-release=Unknown"},"correlation_id":"01M16WB0JKPAFFN5HA9WGP5W3J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:25.418Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-e867059205a5b0e544ee9103: done: 0.068551 sec","job_status":"done","queue_duration_s":0.40819,"scheduling_latency_s":0.408244,"redis_calls":7,"redis_duration_s":0.008054,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006673,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001381,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.044761,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.068551,"completed_at":"2026-08-29T13:46:25.895Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007156,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2567gitlab # [ 439.164250] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:25.898Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"4c9f4f30825285a64e0d0384","created_at":"2026-08-29T13:46:25.421Z","trace_propagation_headers":{"sentry-trace":"96697051ffd24f43b1e88f5da86df310-b85279b18b6e455c","baggage":"sentry-trace_id=96697051ffd24f43b1e88f5da86df310,sentry-release=Unknown"},"correlation_id":"01M16WB0JKPAFFN5HA9WGP5W3J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:25.427Z","job_size_bytes":19,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-4c9f4f30825285a64e0d0384: start","job_status":"start","queue_duration_s":0.471256,"scheduling_latency_s":0.471288}2568gitlab # [ 439.180367] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:25.947Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"4c9f4f30825285a64e0d0384","created_at":"2026-08-29T13:46:25.421Z","trace_propagation_headers":{"sentry-trace":"96697051ffd24f43b1e88f5da86df310-b85279b18b6e455c","baggage":"sentry-trace_id=96697051ffd24f43b1e88f5da86df310,sentry-release=Unknown"},"correlation_id":"01M16WB0JKPAFFN5HA9WGP5W3J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:25.427Z","job_size_bytes":19,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-4c9f4f30825285a64e0d0384: done: 0.048671 sec","job_status":"done","queue_duration_s":0.471256,"scheduling_latency_s":0.471288,"redis_calls":8,"redis_duration_s":0.002168,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001387,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000781,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031312,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.048671,"completed_at":"2026-08-29T13:46:25.947Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009112,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2569gitlab # [ 439.224152] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:25.950Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"22d38458886a3ab16e064d08","created_at":"2026-08-29T13:46:25.430Z","trace_propagation_headers":{"sentry-trace":"96697051ffd24f43b1e88f5da86df310-b85279b18b6e455c","baggage":"sentry-trace_id=96697051ffd24f43b1e88f5da86df310,sentry-release=Unknown"},"correlation_id":"01M16WB0JKPAFFN5HA9WGP5W3J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:25.433Z","job_size_bytes":66,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-22d38458886a3ab16e064d08: start","job_status":"start","queue_duration_s":0.516401,"scheduling_latency_s":0.516425}2570gitlab # [ 439.241679] gitaly[896]: time="2026-08-29T13:46:25.934Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=3 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M16WB1N82GD3CTG920X9VN75 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-29T13:46:25.913" grpc.time_ms=20.215 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc2571gitlab # [ 439.255643] gitaly[896]: time="2026-08-29T13:46:26.023Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M16WB1RK4XTSVKHBGHSTG9ZR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-29T13:46:26.004" pid=896 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2572gitlab # [ 439.266621] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:46:25 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1022573gitlab # [ 439.268731] gitlab-workhorse[822]: time="2026-08-29T13:46:26Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672574gitlab # [ 439.270533] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:46:26 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 852575gitlab # [ 439.272777] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:25.981Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"22d38458886a3ab16e064d08","created_at":"2026-08-29T13:46:25.430Z","trace_propagation_headers":{"sentry-trace":"96697051ffd24f43b1e88f5da86df310-b85279b18b6e455c","baggage":"sentry-trace_id=96697051ffd24f43b1e88f5da86df310,sentry-release=Unknown"},"correlation_id":"01M16WB0JKPAFFN5HA9WGP5W3J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:25.433Z","job_size_bytes":66,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-22d38458886a3ab16e064d08: done: 0.03151 sec","job_status":"done","queue_duration_s":0.516401,"scheduling_latency_s":0.516425,"redis_calls":7,"redis_duration_s":0.001202,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000869,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000333,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020965,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03151,"completed_at":"2026-08-29T13:46:25.981Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005926,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2576gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/a868350d45cf235a21d84a90a239221281f6ba62/statuses, in 0.25 seconds)2577(finished: subtest: eval and build post commit statuses, in 10.20 seconds)2578(finished: run the VM test script, in 510.74 seconds)2579gitlab # [ 439.317909] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:25.984Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"daa9c7fa59c02bed2d0cdaf8","created_at":"2026-08-29T13:46:25.437Z","trace_propagation_headers":{"sentry-trace":"96697051ffd24f43b1e88f5da86df310-b85279b18b6e455c","baggage":"sentry-trace_id=96697051ffd24f43b1e88f5da86df310,sentry-release=Unknown"},"correlation_id":"01M16WB0JKPAFFN5HA9WGP5W3J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:25.441Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-daa9c7fa59c02bed2d0cdaf8: start","job_status":"start","queue_duration_s":0.542165,"scheduling_latency_s":0.542186}2580gitlab # [ 439.333408] gitaly[896]: time="2026-08-29T13:46:26.023Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=4 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M16WB1RK4XTSVKHBGHSTG9ZR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-29T13:46:26.004" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=896 remote_ip="2001:db8:1::1" span.kind=server system=grpc2581gitlab # [ 439.349847] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/29:13:46:26 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/a868350d45cf235a21d84a90a239221281f6ba62/statuses HTTP/1.1" 200 1328 "" "curl/8.21.0" 1332582test script finished in 510.79s2583cleanup2584kill QemuMachine (pid 46)2585gitlab # [ 439.352660] sidekiq-cluster[3497]: {"severity":"INFO","time":"2026-08-29T13:46:26.037Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"daa9c7fa59c02bed2d0cdaf8","created_at":"2026-08-29T13:46:25.437Z","trace_propagation_headers":{"sentry-trace":"96697051ffd24f43b1e88f5da86df310-b85279b18b6e455c","baggage":"sentry-trace_id=96697051ffd24f43b1e88f5da86df310,sentry-release=Unknown"},"correlation_id":"01M16WB0JKPAFFN5HA9WGP5W3J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-29T13:46:25.441Z","job_size_bytes":3,"pid":3497,"sidekiq_tid":"m8qp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-daa9c7fa59c02bed2d0cdaf8: done: 0.053732 sec","job_status":"done","queue_duration_s":0.542165,"scheduling_latency_s":0.542186,"redis_calls":7,"redis_duration_s":0.0017079999999999999,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001241,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000467,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_reqemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/41m77i1296n33p6liin8ynr6wh3h6b7m-python3-3.14.6/bin/python3.14)2586(finished: cleanup, in 1.40 seconds)2587additionally exposed symbols:2588 gitlab,2589 vlan1,2590 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2591[]2592[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-08-29T13:44:43.159Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2593[]2594[]2595[]2596[]2597[]2598[]2599[]2600[]2601[]2602[]2603[]2604[]2605[]2606[]2607[]2608[]2609[]2610[]2611[]2612[]2613[]2614[]2615[]2616[]2617[]2618[]2619[]2620[]2621[]2622[]2623[]2624[]2625[]2626[]2627[]2628[]2629[]2630[]2631[]2632[]2633[]2634[]2635[]2636[]2637[]2638[]2639[]2640[]2641[]2642[]2643[]2644[]2645[]2646[]2647[]2648[]2649[]2650[]2651[]2652[]2653[]2654[]2655[]2656[]2657[]2658[]2659[]2660[]2661[]2662[]2663[]2664[]2665[]2666[]2667[]2668[]2669[]2670[]2671[]2672[]2673[]2674[]2675[]2676[]2677[]2678[]2679[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': 'a868350d45cf235a21d84a90a239221281f6ba62', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': [{'level': 'warning', 'message': "unable to download 'https://cache.nixos.org/…': Could not resolve hostname (6) Could not resolve host: cache.nixos.org", 'count': 1}], 'error': None, 'created_at': '2026-08-29T13:46:14.958613Z', 'started_at': '2026-08-29T13:46:15.290064Z', 'finished_at': None, 'eval_queue': None}]2680[{'id': 5, 'sha': 'a868350d45cf235a21d84a90a239221281f6ba62', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-08-29T13:46:15.256Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2681[{'id': 5, 'sha': 'a868350d45cf235a21d84a90a239221281f6ba62', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-08-29T13:46:15.256Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2682[{'id': 5, 'sha': 'a868350d45cf235a21d84a90a239221281f6ba62', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-08-29T13:46:15.256Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2683[{'id': 5, 'sha': 'a868350d45cf235a21d84a90a239221281f6ba62', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-08-29T13:46:15.256Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2684[{'id': 5, 'sha': 'a868350d45cf235a21d84a90a239221281f6ba62', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-08-29T13:46:15.256Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2685[{'id': 5, 'sha': 'a868350d45cf235a21d84a90a239221281f6ba62', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-08-29T13:46:15.256Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2686[{'id': 5, 'sha': 'a868350d45cf235a21d84a90a239221281f6ba62', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-08-29T13:46:15.256Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2687[{'id': 5, 'sha': 'a868350d45cf235a21d84a90a239221281f6ba62', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-08-29T13:46:15.256Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2688[{'id': 5, 'sha': 'a868350d45cf235a21d84a90a239221281f6ba62', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-08-29T13:46:15.256Z', 'started_at': None, 'finished_at': '2026-08-29T13:46:25.019Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': 'a868350d45cf235a21d84a90a239221281f6ba62', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '0 attributes built', 'created_at': '2026-08-29T13:46:25.342Z', 'started_at': None, 'finished_at': '2026-08-29T13:46:25.597Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]