vm-test-run-nixbot-gitlab
checks.aarch64-linux.nixbot-gitlab
· build #247
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab # Disk image does not exist, creating the virtualisation disk image...10gitlab: QEMU running (pid 46)11gitlab # Formatting '/build/vm-state-gitlab/tmp.RgAMh5oKQo', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13gitlab # Discarding device blocks: 0/262144 done14gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes15(finished: start all VMs, in 72.08 seconds)16gitlab # Filesystem UUID: fb97106f-1ef6-4ea6-bc56-56779bd3388a17gitlab: waiting for unit setup-gitlab.service18gitlab # Superblock backups stored on blocks:19gitlab: waiting for the VM to finish booting20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]31gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Thu Aug 6 17:27:09 UTC 202632gitlab # [ 0.000000] KASLR enabled33gitlab # [ 0.000000] random: crng init done34gitlab # [ 0.000000] Machine model: linux,dummy-virt35gitlab # [ 0.000000] efi: UEFI not found.36gitlab # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT37gitlab # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff]38gitlab # [ 0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf]39gitlab # [ 0.000000] Zone ranges:40gitlab # [ 0.000000] DMA [mem 0x0000000040000000-0x00000000ffffffff]41gitlab # [ 0.000000] DMA32 empty42gitlab # [ 0.000000] Normal [mem 0x0000000100000000-0x00000001bfffffff]43gitlab # [ 0.000000] Device empty44gitlab # [ 0.000000] Movable zone start for each node45gitlab # [ 0.000000] Early memory node ranges46gitlab # [ 0.000000] node 0: [mem 0x0000000040000000-0x00000001bfffffff]47gitlab # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff]48gitlab # [ 0.000000] cma: Reserved 32 MiB at 0x00000000fe00000049gitlab # [ 0.000000] psci: probing for conduit method from DT.50gitlab # [ 0.000000] psci: PSCIv1.3 detected in firmware.51gitlab # [ 0.000000] psci: Using standard PSCI v0.2 function IDs52gitlab # [ 0.000000] psci: Trusted OS migration not required53gitlab # [ 0.000000] psci: SMC Calling Convention v1.154gitlab # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)55gitlab # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u31129656gitlab # [ 0.000000] Detected PIPT I-cache on CPU057gitlab # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)58gitlab # [ 0.000000] CPU features: detected: GICv3 CPU interface59gitlab # [ 0.000000] CPU features: detected: Spectre-v460gitlab # [ 0.000000] CPU features: detected: Spectre-BHB61gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_3862gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_2363gitlab # [ 0.000000] alternatives: applying boot alternatives64gitlab # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/pxk12a30145h8ys1gmgb2868cyas6jzi-nixos-system-gitlab-test/init regInfo=/nix/store/ldjzgkygiln4kpjgfycr4vyqwgxmym62-closure-info/registration console=ttyAMA0,115200n8 console=tty065gitlab # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/ldjzgkygiln4kpjgfycr4vyqwgxmym62-closure-info/registration", will be passed to user space.66gitlab # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes67gitlab # [ 0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)68gitlab # [ 0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)69gitlab # [ 0.000000] software IO TLB: area num 4.70gitlab # [ 0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB)71gitlab # [ 0.000000] Fallback order for Node 0: 072gitlab # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 157286473gitlab # [ 0.000000] Policy zone: Normal74gitlab # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off75gitlab # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=176gitlab # [ 0.000000] allocated 12582912 bytes of page_ext77gitlab # [ 0.000000] ftrace: allocating 74867 entries in 294 pages78gitlab # [ 0.000000] ftrace: allocated 294 pages with 4 groups79gitlab # [ 0.000000] rcu: Hierarchical RCU implementation.80gitlab # [ 0.000000] rcu: RCU event tracing is enabled.81gitlab # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.82gitlab # [ 0.000000] Trampoline variant of Tasks RCU enabled.83gitlab # [ 0.000000] Rude variant of Tasks RCU enabled.84gitlab # [ 0.000000] Tracing variant of Tasks RCU enabled.85gitlab # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.86gitlab # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=487gitlab # [ 0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.88gitlab # [ 0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.89gitlab # [ 0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.90gitlab # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 091gitlab # [ 0.000000] GICv3: 256 SPIs implemented92gitlab # [ 0.000000] GICv3: 0 Extended SPIs implemented93gitlab # [ 0.000000] Root IRQ handler: gic_handle_irq94gitlab # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI95gitlab # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=096gitlab # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a000097gitlab # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]98gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f00000 (indirect, esz 8, psz 64K, shr 1)99gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f10000 (flat, esz 8, psz 64K, shr 1)100gitlab # [ 0.000000] GICv3: using LPI property table @0x0000000100f20000101gitlab # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f40000102gitlab # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.103gitlab # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns104gitlab # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).105gitlab # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns106gitlab # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns107gitlab # [ 0.000029] arm-pv: using stolen time PV108gitlab # [ 0.000390] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)109gitlab # [ 0.000574] Console: colour dummy device 80x25110gitlab # [ 0.000581] printk: legacy console [tty0] enabled111gitlab # [ 0.000764] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)112gitlab # [ 0.000771] pid_max: default: 32768 minimum: 301113gitlab # [ 0.000872] LSM: initializing lsm=capability,landlock,yama,bpf,ima114gitlab # [ 0.000997] landlock: Up and running.115gitlab # [ 0.001000] Yama: becoming mindful.116gitlab # [ 0.001432] LSM support for eBPF active117gitlab # [ 0.001605] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)118gitlab # [ 0.001709] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)119gitlab # [ 0.002843] cacheinfo: Unable to detect cache hierarchy for CPU 0120gitlab # [ 0.003550] rcu: Hierarchical SRCU implementation.121gitlab # [ 0.003554] rcu: Max phase no-delay instances is 1000.122gitlab # [ 0.003705] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level123gitlab # [ 0.004753] fsl-mc MSI: its@8080000 domain created124gitlab # [ 0.004850] EFI services will not be available.125gitlab # [ 0.005061] smp: Bringing up secondary CPUs ...126gitlab # [ 0.005688] Detected PIPT I-cache on CPU1127gitlab # [ 0.005790] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000128gitlab # [ 0.005911] GICv3: CPU1: using allocated LPI pending table @0x0000000100f50000129gitlab # [ 0.006038] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40]130gitlab # [ 0.007216] Detected PIPT I-cache on CPU2131gitlab # [ 0.007323] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000132gitlab # [ 0.007446] GICv3: CPU2: using allocated LPI pending table @0x0000000100f60000133gitlab # [ 0.007570] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40]134gitlab # [ 0.008602] Detected PIPT I-cache on CPU3135gitlab # [ 0.008719] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000136gitlab # [ 0.008841] GICv3: CPU3: using allocated LPI pending table @0x0000000100f70000137gitlab # [ 0.008966] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40]138gitlab # [ 0.009479] smp: Brought up 1 node, 4 CPUs139gitlab # [ 0.009504] SMP: Total of 4 processors activated.140gitlab # [ 0.009507] CPU: All CPU(s) started at EL1141gitlab # [ 0.009516] CPU features: detected: Branch Target Identification142gitlab # [ 0.009520] CPU features: detected: ARMv8.4 Translation Table Level143gitlab # [ 0.009523] CPU features: detected: Instruction cache invalidation not required for I/D coherence144gitlab # [ 0.009527] CPU features: detected: Data cache clean to the PoU not required for I/D coherence145gitlab # [ 0.009530] CPU features: detected: Common not Private translations146gitlab # [ 0.009533] CPU features: detected: CRC32 instructions147gitlab # [ 0.009536] CPU features: detected: Data cache clean to Point of Deep Persistence148gitlab # [ 0.009539] CPU features: detected: Data cache clean to Point of Persistence149gitlab # [ 0.009542] CPU features: detected: Data independent timing control (DIT)150gitlab # [ 0.009545] CPU features: detected: E0PD151gitlab # [ 0.009548] CPU features: detected: Enhanced Counter Virtualization152gitlab # [ 0.009551] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)153gitlab # [ 0.009554] CPU features: detected: Enhanced Virtualization Traps154gitlab # [ 0.009557] CPU features: detected: Fine Grained Traps155gitlab # [ 0.009560] CPU features: detected: Generic authentication (architected QARMA5 algorithm)156gitlab # [ 0.009564] CPU features: detected: RCpc load-acquire (LDAPR)157gitlab # [ 0.009567] CPU features: detected: LSE atomic instructions158gitlab # [ 0.009570] CPU features: detected: Privileged Access Never159gitlab # [ 0.009572] CPU features: detected: PMUv3160gitlab # [ 0.009575] CPU features: detected: RAS Extension Support161gitlab # [ 0.009577] CPU features: detected: RASv1p1 Extension Support162gitlab # [ 0.009580] CPU features: detected: Random Number Generator163gitlab # [ 0.009582] CPU features: detected: Speculation barrier (SB)164gitlab # [ 0.009584] CPU features: detected: Stage-2 Force Write-Back165gitlab # [ 0.009587] CPU features: detected: TLB range maintenance instructions166gitlab # [ 0.009591] CPU features: detected: Speculative Store Bypassing Safe (SSBS)167gitlab # [ 0.009711] alternatives: applying system-wide alternatives168gitlab # [ 0.012735] CPU features: detected: BBM Level 2 without TLB conflict abort169gitlab # [ 0.012971] Memory: 5963804K/6291456K available (24448K kernel code, 7090K rwdata, 26340K rodata, 4736K init, 1106K bss, 272908K reserved, 32768K cma-reserved)170gitlab # [ 0.014442] devtmpfs: initialized171gitlab # [ 0.018397] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)172gitlab # [ 0.018469] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).173gitlab # [ 0.018685] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL174gitlab # [ 0.018689] 0 pages in range for non-PLT usage175gitlab # [ 0.018691] 508288 pages in range for PLT usage176gitlab # [ 0.018792] pinctrl core: initialized pinctrl subsystem177gitlab # [ 0.019590] DMI not present or invalid.178gitlab # [ 0.022760] NET: Registered PF_NETLINK/PF_ROUTE protocol family179gitlab # [ 0.025341] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations180gitlab # [ 0.025629] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations181gitlab # [ 0.027351] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations182gitlab # [ 0.027377] audit: initializing netlink subsys (disabled)183gitlab # [ 0.027686] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1184gitlab # [ 0.028242] thermal_sys: Registered thermal governor 'fair_share'185gitlab # [ 0.028246] thermal_sys: Registered thermal governor 'bang_bang'186gitlab # [ 0.028250] thermal_sys: Registered thermal governor 'step_wise'187gitlab # [ 0.028253] thermal_sys: Registered thermal governor 'user_space'188gitlab # [ 0.028255] thermal_sys: Registered thermal governor 'power_allocator'189gitlab # [ 0.028337] cpuidle: using governor ladder190gitlab # [ 0.028360] cpuidle: using governor menu191gitlab # [ 0.028561] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.192gitlab # [ 0.028780] ASID allocator initialised with 65536 entries193gitlab # [ 0.029904] Serial: AMBA PL011 UART driver194gitlab # [ 0.035047] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1195gitlab # [ 0.035361] printk: console [ttyAMA0] enabled196gitlab # [ 0.047636] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages197gitlab # [ 0.047655] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page198gitlab # [ 0.047664] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages199gitlab # [ 0.047673] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page200gitlab # [ 0.047681] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages201gitlab # [ 0.047689] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page202gitlab # [ 0.047697] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages203gitlab # [ 0.047705] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page204gitlab # [ 0.060210] fbcon: Taking over console205gitlab # [ 0.060243] ACPI: Interpreter disabled.206gitlab # [ 0.063126] iommu: Default domain type: Translated207gitlab # [ 0.063137] iommu: DMA domain TLB invalidation policy: strict mode208gitlab # [ 0.088368] SCSI subsystem initialized209gitlab # [ 0.088960] usbcore: registered new interface driver usbfs210gitlab # [ 0.089016] usbcore: registered new interface driver hub211gitlab # [ 0.089050] usbcore: registered new device driver usb212gitlab # [ 0.089603] pps_core: LinuxPPS API ver. 1 registered213gitlab # [ 0.089610] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>214gitlab # [ 0.089626] PTP clock support registered215gitlab # [ 0.089715] EDAC MC: Ver: 3.0.0216gitlab # [ 0.090180] scmi_core: SCMI protocol bus registered217gitlab # [ 0.091083] FPGA manager framework218gitlab # [ 0.092218] vgaarb: loaded219gitlab # [ 0.094529] clocksource: Switched to clocksource arch_sys_counter220gitlab # [ 0.095231] VFS: Disk quotas dquot_6.6.0221gitlab # [ 0.095279] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)222gitlab # [ 0.095835] netfs: FS-Cache loaded223gitlab # [ 0.096050] pnp: PnP ACPI: disabled224gitlab # [ 0.103506] NET: Registered PF_INET protocol family225gitlab # [ 0.104858] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)226gitlab # [ 0.142148] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)227gitlab # [ 0.142212] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)228gitlab # [ 0.142274] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)229gitlab # [ 0.142706] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)230gitlab # [ 0.143376] TCP: Hash tables configured (established 65536 bind 65536)231gitlab # [ 0.143509] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)232gitlab # [ 0.143576] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)233gitlab # [ 0.143709] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)234gitlab # [ 0.143958] NET: Registered PF_UNIX/PF_LOCAL protocol family235gitlab # [ 0.144021] NET: Registered PF_XDP protocol family236gitlab # [ 0.144065] PCI: CLS 0 bytes, default 64237gitlab # [ 0.144427] Trying to unpack rootfs image as initramfs...238gitlab # [ 0.150851] kvm [1]: HYP mode not available239gitlab # [ 0.202019] Initialise system trusted keyrings240gitlab # [ 0.202308] workingset: timestamp_bits=42 max_order=21 bucket_order=0241gitlab # [ 0.203090] squashfs: version 4.0 (2009/01/31) Phillip Lougher242gitlab # [ 0.203244] 9p: Installing v9fs 9p2000 file system support243gitlab # [ 0.215199] Key type asymmetric registered244gitlab # [ 0.215204] Asymmetric key parser 'x509' registered245gitlab # [ 0.215272] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)246gitlab # [ 0.215559] io scheduler mq-deadline registered247gitlab # [ 0.215564] io scheduler kyber registered248gitlab # [ 0.223731] pl061_gpio 9030000.pl061: PL061 GPIO chip registered249gitlab # [ 0.227130] ledtrig-cpu: registered to indicate activity on CPUs250gitlab # [ 0.227631] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:251gitlab # [ 0.227647] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000252gitlab # [ 0.227659] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000253gitlab # [ 0.227666] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000254gitlab # [ 0.227684] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits255gitlab # [ 0.227710] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]256gitlab # [ 0.227799] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00257gitlab # [ 0.227807] pci_bus 0000:00: root bus resource [bus 00-ff]258gitlab # [ 0.227812] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]259gitlab # [ 0.227815] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]260gitlab # [ 0.227818] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]261gitlab # [ 0.227894] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint262gitlab # [ 0.228442] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint263gitlab # [ 0.228658] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]264gitlab # [ 0.228672] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]265gitlab # [ 0.228699] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]266gitlab # [ 0.228712] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]267gitlab # [ 0.229290] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint268gitlab # [ 0.229520] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]269gitlab # [ 0.229533] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]270gitlab # [ 0.229560] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]271gitlab # [ 0.230116] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint272gitlab # [ 0.230328] pci 0000:00:03.0: BAR 0 [io 0x0000-0x001f]273gitlab # [ 0.230340] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]274gitlab # [ 0.230367] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]275gitlab # [ 0.230947] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint276gitlab # [ 0.231172] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]277gitlab # [ 0.231185] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]278gitlab # [ 0.231218] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]279gitlab # [ 0.231781] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint280gitlab # [ 0.232000] pci 0000:00:05.0: BAR 0 [io 0x0000-0x007f]281gitlab # [ 0.232013] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]282gitlab # [ 0.232049] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]283gitlab # [ 0.232611] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint284gitlab # [ 0.232824] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]285gitlab # [ 0.232837] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]286gitlab # [ 0.232869] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]287gitlab # [ 0.233456] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint288gitlab # [ 0.233678] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]289gitlab # [ 0.233690] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]290gitlab # [ 0.233722] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]291gitlab # [ 0.233735] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]292gitlab # [ 0.234289] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint293gitlab # [ 0.234515] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]294gitlab # [ 0.234564] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]295gitlab # [ 0.235091] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint296gitlab # [ 0.235312] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]297gitlab # [ 0.235340] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]298gitlab # [ 0.235843] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint299gitlab # [ 0.236052] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]300gitlab # [ 0.236362] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint301gitlab # [ 0.236676] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]302gitlab # [ 0.236689] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]303gitlab # [ 0.236717] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]304gitlab # [ 0.237287] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint305gitlab # [ 0.237502] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]306gitlab # [ 0.237515] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]307gitlab # [ 0.237542] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]308gitlab # [ 0.238200] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned309gitlab # [ 0.238208] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned310gitlab # [ 0.238212] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned311gitlab # [ 0.238256] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned312gitlab # [ 0.238301] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned313gitlab # [ 0.238356] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned314gitlab # [ 0.238402] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned315gitlab # [ 0.238449] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned316gitlab # [ 0.238498] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned317gitlab # [ 0.238560] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned318gitlab # [ 0.238614] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned319gitlab # [ 0.238664] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned320gitlab # [ 0.238735] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned321gitlab # [ 0.238785] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned322gitlab # [ 0.238804] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned323gitlab # [ 0.238823] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned324gitlab # [ 0.238841] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned325gitlab # [ 0.238866] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned326gitlab # [ 0.238886] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned327gitlab # [ 0.238905] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned328gitlab # [ 0.238925] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned329gitlab # [ 0.238944] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned330gitlab # [ 0.238967] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned331gitlab # [ 0.238987] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned332gitlab # [ 0.239007] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned333gitlab # [ 0.239025] pci 0000:00:05.0: BAR 0 [io 0x1000-0x107f]: assigned334gitlab # [ 0.239044] pci 0000:00:06.0: BAR 0 [io 0x1080-0x10ff]: assigned335gitlab # [ 0.239064] pci 0000:00:0b.0: BAR 0 [io 0x1100-0x113f]: assigned336gitlab # [ 0.239082] pci 0000:00:01.0: BAR 0 [io 0x1140-0x115f]: assigned337gitlab # [ 0.239107] pci 0000:00:02.0: BAR 0 [io 0x1160-0x117f]: assigned338gitlab # [ 0.239126] pci 0000:00:03.0: BAR 0 [io 0x1180-0x119f]: assigned339gitlab # [ 0.239145] pci 0000:00:04.0: BAR 0 [io 0x11a0-0x11bf]: assigned340gitlab # [ 0.239164] pci 0000:00:07.0: BAR 0 [io 0x11c0-0x11df]: assigned341gitlab # [ 0.239183] pci 0000:00:0c.0: BAR 0 [io 0x11e0-0x11ff]: assigned342gitlab # [ 0.239208] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]343gitlab # [ 0.239214] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]344gitlab # [ 0.239217] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]345gitlab # [ 0.240606] pci 0000:00:0a.0: enabling device (0000 -> 0002)346gitlab # [ 0.254658] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)347gitlab # [ 0.257000] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)348gitlab # [ 0.259412] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)349gitlab # [ 0.261680] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)350gitlab # [ 0.263990] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)351gitlab # [ 0.269654] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)352gitlab # [ 0.271834] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)353gitlab # [ 0.274189] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)354gitlab # [ 0.276537] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)355gitlab # [ 0.278522] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)356gitlab # [ 0.284824] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)357gitlab # [ 0.291203] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled358gitlab # [ 0.293230] msm_serial: driver initialized359gitlab # [ 0.293368] SuperH (H)SCI(F) driver initialized360gitlab # [ 0.293426] STM32 USART driver initialized361gitlab # [ 0.319666] loop: module loaded362gitlab # [ 0.319885] virtio_blk virtio4: 4/0/0 default/read/poll queues363gitlab # [ 0.321925] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)364gitlab # [ 0.323962] virtio_blk virtio5: 4/0/0 default/read/poll queues365gitlab # [ 0.325966] virtio_blk virtio5: [vdb] 12204232 512-byte logical blocks (6.25 GB/5.82 GiB)366gitlab # [ 0.328459] megasas: 07.734.00.00-rc1367gitlab # [ 0.329326] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]368gitlab # [ 0.333612] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000369gitlab # [ 0.333635] Intel/Sharp Extended Query Table at 0x0031370gitlab # [ 0.335273] Using buffer write method371gitlab # [ 0.335320] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]372gitlab # [ 0.337091] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000373gitlab # [ 0.337113] Intel/Sharp Extended Query Table at 0x0031374gitlab # [ 0.338714] Using buffer write method375gitlab # [ 0.338735] Concatenating MTD devices:376gitlab # [ 0.338737] (0): "0.flash"377gitlab # [ 0.338740] (1): "0.flash"378gitlab # [ 0.338742] into device "0.flash"379gitlab # [ 0.668830] Freeing initrd memory: 27184K380gitlab # [ 0.687109] tun: Universal TUN/TAP device driver, 1.6381gitlab # [ 0.695870] thunder_xcv, ver 1.0382gitlab # [ 0.696107] thunder_bgx, ver 1.0383gitlab # [ 0.696184] nicpf, ver 1.0384gitlab # [ 0.698037] e1000: Intel(R) PRO/1000 Network Driver385gitlab # [ 0.698048] e1000: Copyright (c) 1999-2006 Intel Corporation.386gitlab # [ 0.698129] e1000e: Intel(R) PRO/1000 Network Driver387gitlab # [ 0.698145] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.388gitlab # [ 0.698247] igb: Intel(R) Gigabit Ethernet Network Driver389gitlab # [ 0.698257] igb: Copyright (c) 2007-2014 Intel Corporation.390gitlab # [ 0.698332] igbvf: Intel(R) Gigabit Virtual Function Network Driver391gitlab # [ 0.698342] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.392gitlab # [ 0.698820] sky2: driver version 1.30393gitlab # [ 0.704329] usbcore: registered new interface driver usb-storage394gitlab # [ 0.704625] usbcore: registered new interface driver usbserial_generic395gitlab # [ 0.704716] usbserial: USB Serial support registered for generic396gitlab # [ 0.704730] ehci-pci 0000:00:0a.0: EHCI Host Controller397gitlab # [ 0.704786] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1398gitlab # [ 0.705739] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000399gitlab # [ 0.706795] hv_vmbus: registering driver hyperv_keyboard400gitlab # [ 0.709937] rtc-pl031 9010000.pl031: registered as rtc0401gitlab # [ 0.709999] rtc-pl031 9010000.pl031: setting system clock to 2026-08-20T05:53:07 UTC (1787205187)402gitlab # [ 0.711013] i2c_dev: i2c /dev entries driver403gitlab # [ 0.714683] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00404gitlab # [ 0.716553] hub 1-0:1.0: USB hub found405gitlab # [ 0.716760] hub 1-0:1.0: 6 ports detected406gitlab # [ 0.719956] sdhci: Secure Digital Host Controller Interface driver407gitlab # [ 0.719972] sdhci: Copyright(c) Pierre Ossman408gitlab # [ 0.720872] Synopsys Designware Multimedia Card Interface Driver409gitlab # [ 0.722074] sdhci-pltfm: SDHCI platform and OF driver helper410gitlab # [ 0.726857] hid: raw HID events driver (C) Jiri Kosina411gitlab # [ 0.727634] usbcore: registered new interface driver usbhid412gitlab # [ 0.727644] usbhid: USB HID core driver413gitlab # [ 0.731385] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available414gitlab # [ 0.735399] drop_monitor: Initializing network drop monitor service415gitlab # [ 0.735654] NET: Registered PF_INET6 protocol family416gitlab # [ 0.737375] Segment Routing with IPv6417gitlab # [ 0.737473] In-situ OAM (IOAM) with IPv6418gitlab # [ 0.737533] NET: Registered PF_PACKET protocol family419gitlab # [ 0.737814] 9pnet: Installing 9P2000 support420gitlab # [ 0.741549] Key type dns_resolver registered421gitlab # [ 0.758135] registered taskstats version 1422gitlab # [ 0.758572] Loading compiled-in X.509 certificates423gitlab # [ 0.777149] Demotion targets for Node 0: null424gitlab # [ 0.777372] Key type .fscrypt registered425gitlab # [ 0.777378] Key type fscrypt-provisioning registered426gitlab # [ 0.777550] ima: No TPM chip found, activating TPM-bypass!427gitlab # [ 0.777572] ima: Allocated hash algorithm: sha1428gitlab # [ 0.777601] ima: No architecture policies found429gitlab # [ 0.778854] input: gpio-keys as /devices/platform/gpio-keys/input/input0430gitlab # [ 0.801675] clk: Disabling unused clocks431gitlab # [ 0.801705] PM: genpd: Disabling unused power domains432gitlab # [ 0.806402] Freeing unused kernel memory: 4736K433gitlab # [ 0.806639] Run /init as init process434gitlab # [ 0.842472] systemd[1]: Successfully made /usr/ read-only.435gitlab # [ 0.962661] usb 1-1: new high-speed USB device number 2 using ehci-pci436gitlab # [ 1.121654] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1437gitlab # [ 1.177256] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)438gitlab # [ 1.177324] systemd[1]: Detected virtualization qemu.439gitlab # [ 1.177400] systemd[1]: Detected architecture arm64.440gitlab # [ 1.177416] systemd[1]: Running in initrd.441gitlab # [ 1.178260] systemd[1]: Initializing machine ID from random generator.442gitlab # [ 1.178571] systemd[1]: Hostname set to <gitlab>.443gitlab # [ 1.263290] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0444gitlab # [ 1.382613] usb 1-2: new high-speed USB device number 3 using ehci-pci445gitlab # [ 1.537091] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2446gitlab # [ 1.537619] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0447gitlab # [ 1.538436] systemd[1]: bpf-restrict-fs: LSM BPF program attached448gitlab # [ 1.640640] systemd[1]: Queued start job for default target Initrd Default Target.449gitlab # [ 1.658801] systemd[1]: Created slice Slice /system/modprobe.450gitlab # [ 1.659166] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.451gitlab # [ 1.659217] systemd[1]: Expecting device /dev/disk/by-label/nix-store...452gitlab # [ 1.659238] systemd[1]: Expecting device /dev/disk/by-label/nixos...453gitlab # [ 1.659268] systemd[1]: Reached target Path Units.454gitlab # [ 1.659296] systemd[1]: Reached target Slice Units.455gitlab # [ 1.659319] systemd[1]: Reached target Swaps.456gitlab # [ 1.659344] systemd[1]: Reached target Timer Units.457gitlab # [ 1.659582] systemd[1]: Listening on D-Bus System Message Bus Socket.458gitlab # [ 1.659884] systemd[1]: Listening on Journal Socket (/dev/log).459gitlab # [ 1.660141] systemd[1]: Listening on Journal Sockets.460gitlab # [ 1.660352] systemd[1]: Listening on udev Control Socket.461gitlab # [ 1.660494] systemd[1]: Listening on udev Kernel Socket.462gitlab # [ 1.660525] systemd[1]: Reached target Socket Units.463gitlab # [ 1.663194] systemd[1]: Starting Create List of Static Device Nodes...464gitlab # [ 1.665800] systemd[1]: Starting Load Kernel Module 9pnet_virtio...465gitlab # [ 1.665913] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs466gitlab # [ 1.668489] systemd[1]: Mounting Kernel Configuration File System...467gitlab # [ 1.695242] systemd[1]: Starting Journal Service...468gitlab # [ 1.699218] systemd[1]: Starting Load Kernel Modules...469gitlab # [ 1.699487] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os470gitlab # [ 1.706996] systemd[1]: Starting Coldplug All udev Devices...471gitlab # [ 1.712093] systemd[1]: Finished Create List of Static Device Nodes.472gitlab # [ 1.714933] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.473gitlab # [ 1.715947] systemd[1]: Finished Load Kernel Module 9pnet_virtio.474gitlab # [ 1.716967] systemd[1]: Mounted Kernel Configuration File System.475gitlab # [ 1.721418] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...476gitlab # [ 1.740816] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0477gitlab # [ 1.740977] [drm] features: -virgl +edid -resource_blob -host_visible478gitlab # [ 1.740982] [drm] features: -context_init479gitlab # [ 1.741945] [drm] number of scanouts: 1480gitlab # [ 1.741958] [drm] number of cap sets: 0481gitlab # [ 1.748270] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.482gitlab # [ 1.752777] systemd-journald[94]: Collecting audit messages is disabled.483gitlab # [ 1.753615] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev484gitlab # [ 1.755801] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.485gitlab # [ 1.760929] systemd[1]: Starting Create Static Device Nodes in /dev...486gitlab # [ 1.761052] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic487gitlab # [ 1.761067] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0488gitlab # [ 1.774476] Console: switching to colour frame buffer device 160x50489gitlab # [ 1.775344] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device490gitlab # [ 1.790947] systemd[1]: Finished Create Static Device Nodes in /dev.491gitlab # [ 1.792823] systemd[1]: Finished Load Kernel Modules.492gitlab # [ 1.793033] systemd[1]: Reached target Preparation for Local File Systems.493gitlab # [ 1.793085] systemd[1]: Reached target Local File Systems.494gitlab # [ 1.795033] systemd[1]: Starting Apply Kernel Variables...495gitlab # [ 1.803276] systemd[1]: Starting Rule-based Manager for Device Events and Files...496gitlab # [ 1.833704] systemd-modules-load[95]: Using 4 probe threads497gitlab # [ 1.837443] systemd[1]: Started Journal Service.498gitlab # [ 1.838014] systemd-modules-load[95]: Module 'virtio_balloon' is built in499gitlab # [ 1.839211] systemd-modules-load[95]: Module 'virtio_console' is built in500gitlab # [ 1.840488] systemd-modules-load[95]: Module 'virtio_rng' is built in501gitlab # [ 1.841717] systemd-modules-load[95]: Inserted module 'dm_mod'502gitlab # [ 1.842718] systemd-modules-load[95]: Inserted module 'virtio_gpu'503gitlab # [ 1.843736] systemd[1]: Starting Create System Files and Directories...504gitlab # [ 1.848193] systemd[1]: Finished Apply Kernel Variables.505gitlab # [ 1.852662] systemd-udevd[106]: Using default interface naming scheme 'v261'.506gitlab # [ 1.861675] systemd[1]: Finished Create System Files and Directories.507gitlab # [ 1.880523] systemd[1]: Started Rule-based Manager for Device Events and Files.508gitlab # [ 1.903166] systemd[1]: Starting Virtual Console Setup...509gitlab # [ 1.968835] systemd-vconsole-setup[128]: Configuration of first virtual console was skipped, ignoring remaining ones.510gitlab # [ 1.974734] systemd[1]: Finished Virtual Console Setup.511gitlab # [ 2.364152] systemd[1]: Finished Coldplug All udev Devices.512gitlab # [ 2.366943] systemd[1]: Reached target System Initialization.513gitlab # [ 2.369608] systemd[1]: Reached target Basic System.514gitlab # [ 2.536523] (udev-worker)[140]: Network interface NamePolicy= disabled on kernel command line.515gitlab # [ 2.549001] (udev-worker)[138]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.516gitlab # [ 2.554397] (udev-worker)[138]: Network interface NamePolicy= disabled on kernel command line.517gitlab # [ 2.576977] systemd[1]: Found device /dev/disk/by-label/nixos.518gitlab # [ 2.580395] systemd[1]: Reached target Initrd Root Device.519gitlab # [ 2.586006] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...520gitlab # [ 2.596588] systemd[1]: Found device /dev/disk/by-label/nix-store.521gitlab # [ 2.642355] systemd-fsck[151]: nixos: clean, 12/65536 files, 13019/262144 blocks522gitlab # [ 2.646791] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.523gitlab # [ 2.708529] systemd[1]: Mounting /sysroot...524gitlab # [ 2.744627] EXT4-fs (vda): mounted filesystem fb97106f-1ef6-4ea6-bc56-56779bd3388a r/w with ordered data mode. Quota mode: none.525gitlab # [ 2.747298] systemd[1]: Mounted /sysroot.526gitlab # [ 2.748139] systemd[1]: Reached target Initrd Root File System.527gitlab # [ 2.752291] systemd[1]: Mounting /sysroot/nix/.ro-store...528gitlab # [ 2.756154] systemd[1]: Mounting /sysroot/nix/.rw-store...529gitlab # [ 2.772430] systemd[1]: Mounting /sysroot/run...530gitlab # [ 2.776707] systemd[1]: Mounting /sysroot/tmp/shared...531gitlab # [ 2.786545] systemd[1]: Mounting /sysroot/tmp/xchg...532gitlab # [ 2.791896] erofs (device vdb): mounted with root inode @ nid 128.533gitlab # [ 2.792442] systemd[1]: Starting Mountpoints Configured in the Real Root...534gitlab # [ 2.797215] systemd[1]: Mounted /sysroot/nix/.ro-store.535gitlab # [ 2.798489] systemd[1]: Mounted /sysroot/nix/.rw-store.536gitlab # [ 2.799556] systemd[1]: Mounted /sysroot/run.537gitlab # [ 2.801945] systemd[1]: Mounted /sysroot/tmp/shared.538gitlab # [ 2.803933] systemd[1]: Mounted /sysroot/tmp/xchg.539gitlab # [ 2.805668] systemd-sysroot-fstab-check[166]: /sysroot should be mounted in the initrd, will request daemon-reload.540gitlab # [ 2.814229] systemd[1]: Starting rw-sysroot-nix-store.service...541gitlab # [ 2.818352] systemd[1]: Reload requested from client PID 166 ('systemd-sysroot') (unit initrd-parse-etc.service)...542gitlab # [ 2.820169] systemd[1]: Reloading...543gitlab # [ 2.925854] systemd[1]: Reloading finished in 109 ms.544gitlab # [ 2.977227] systemd-sysroot-fstab-check[166]: Requesting initrd-fs.target/start/replace...545gitlab # [ 2.978695] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.546gitlab # [ 2.979732] systemd[1]: Finished rw-sysroot-nix-store.service.547gitlab # [ 2.980738] systemd-sysroot-fstab-check[166]: Requesting swap.target/start/replace...548gitlab # [ 2.983510] systemd[1]: initrd-parse-etc.service: Deactivated successfully.549gitlab # [ 2.984898] systemd[1]: Finished Mountpoints Configured in the Real Root.550gitlab # [ 2.985889] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.551gitlab # [ 2.991596] systemd[1]: Starting rw-sysroot-nix-store.service...552gitlab # [ 3.008421] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.553gitlab # [ 3.010225] systemd[1]: Finished rw-sysroot-nix-store.service.554gitlab # [ 3.130422] (udev-worker)[142]: mtd0ro: Failed to find and pin callout binary "/nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/mtd_probe": No such file or directory555gitlab # [ 3.134848] (udev-worker)[142]: mtd0ro: /nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory556gitlab # [ 3.139874] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.557gitlab # [ 3.141094] systemd[1]: Stopped Virtual Console Setup.558gitlab # [ 3.141880] systemd[1]: Stopping Virtual Console Setup...559gitlab # [ 3.142668] systemd[1]: Starting Virtual Console Setup...560gitlab # [ 3.156931] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.561gitlab # [ 3.158016] systemd[1]: Stopped Virtual Console Setup.562gitlab # [ 3.158757] systemd[1]: Starting Virtual Console Setup...563gitlab # [ 3.182117] systemd-vconsole-setup[196]: Configuration of first virtual console was skipped, ignoring remaining ones.564gitlab # [ 3.184835] systemd[1]: Finished Virtual Console Setup.565gitlab # [ 3.714304] systemd[1]: Mounting /sysroot/nix/store...566gitlab # [ 3.798178] systemd[1]: Mounted /sysroot/nix/store.567gitlab # [ 3.800656] systemd[1]: Reached target Initrd File Systems.568gitlab # [ 3.803094] systemd[1]: Starting Find NixOS closure...569gitlab # [ 3.805862] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...570gitlab # [ 3.854372] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.571gitlab # [ 3.858192] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.572gitlab # [ 3.880235] systemd[1]: Finished Find NixOS closure.573gitlab # [ 3.882577] systemd[1]: Reached target Initrd Default Target.574gitlab # [ 3.885171] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...575gitlab # [ 3.936882] systemd[1]: Stopped target Initrd Default Target.576gitlab # [ 3.939453] systemd[1]: Stopped target Basic System.577gitlab # [ 3.941807] systemd[1]: Stopped target Initrd Root Device.578gitlab # [ 3.944219] systemd[1]: Stopped target Path Units.579gitlab # [ 3.946372] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.580gitlab # [ 3.949714] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.581gitlab # [ 3.953053] systemd[1]: Stopped target Slice Units.582gitlab # [ 3.955203] systemd[1]: Stopped target Socket Units.583gitlab # [ 3.960229] systemd[1]: Stopped target System Initialization.584gitlab # [ 3.964141] systemd[1]: Stopped target Swaps.585gitlab # [ 3.967777] systemd[1]: Stopped target Timer Units.586gitlab # [ 3.971586] systemd[1]: dbus.socket: Deactivated successfully.587gitlab # [ 3.975223] systemd[1]: Closed D-Bus System Message Bus Socket.588gitlab # [ 3.978787] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.589gitlab # [ 3.981957] systemd[1]: Stopped Find NixOS closure.590gitlab # [ 3.984052] systemd[1]: Starting Load Kernel Module 9pnet_virtio...591gitlab # [ 3.986261] systemd[1]: Starting rw-sysroot-nix-store.service...592gitlab # [ 3.988374] systemd[1]: systemd-sysctl.service: Deactivated successfully.593gitlab # [ 3.990513] systemd[1]: Stopped Apply Kernel Variables.594gitlab # [ 3.992254] systemd[1]: systemd-modules-load.service: Deactivated successfully.595gitlab # [ 3.994419] systemd[1]: Stopped Load Kernel Modules.596gitlab # [ 3.995873] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.597gitlab # [ 3.998360] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.598gitlab # [ 4.000438] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.599gitlab # [ 4.002327] systemd[1]: Stopped Create System Files and Directories.600gitlab # [ 4.003877] systemd[1]: Stopped target Local File Systems.601gitlab # [ 4.005379] systemd[1]: Stopped target Preparation for Local File Systems.602gitlab # [ 4.006984] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.603gitlab # [ 4.008752] systemd[1]: Stopped Coldplug All udev Devices.604gitlab # [ 4.010148] systemd[1]: Stopping Rule-based Manager for Device Events and Files...605gitlab # [ 4.011848] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.606gitlab # [ 4.013617] systemd[1]: Stopped Virtual Console Setup.607gitlab # [ 4.014743] systemd[1]: initrd-cleanup.service: Deactivated successfully.608gitlab # [ 4.016184] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.609gitlab # [ 4.018698] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.610gitlab # [ 4.020192] systemd[1]: Finished Load Kernel Module 9pnet_virtio.611gitlab # [ 4.021427] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.612gitlab # [ 4.022883] systemd[1]: Finished rw-sysroot-nix-store.service.613gitlab # [ 4.024091] systemd[1]: systemd-udevd.service: Deactivated successfully.614gitlab # [ 4.025435] systemd[1]: Stopped Rule-based Manager for Device Events and Files.615gitlab # [ 4.026913] systemd[1]: systemd-udevd.service: Consumed 2.220s CPU time over 2.210s wall clock time, 31M memory peak.616gitlab # [ 4.029058] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.617gitlab # [ 4.030518] systemd[1]: Closed udev Control Socket.618gitlab # [ 4.031545] systemd[1]: Starting Cleanup udev Database...619gitlab # [ 4.032742] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.620gitlab # [ 4.034300] systemd[1]: Stopped Create Static Device Nodes in /dev.621gitlab # [ 4.035567] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.622gitlab # [ 4.037293] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.623gitlab # [ 4.038745] systemd[1]: kmod-static-nodes.service: Deactivated successfully.624gitlab # [ 4.040360] systemd[1]: Stopped Create List of Static Device Nodes.625gitlab # [ 4.123207] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.626gitlab # [ 4.126971] systemd[1]: Finished Cleanup udev Database.627gitlab # [ 4.129445] systemd[1]: Reached target Switch Root.628gitlab # [ 4.131621] systemd[1]: Starting NixOS Activation...629gitlab # [ 4.341586] initrd-nixos-activation-start[221]: booting system configuration /nix/store/pxk12a30145h8ys1gmgb2868cyas6jzi-nixos-system-gitlab-test630gitlab # [ 4.408971] initrd-nixos-activation-start[221]: running activation script...631gitlab # [ 4.764601] initrd-nixos-activation-start[244]: setting up /etc...632gitlab # [ 4.925611] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.633gitlab # [ 4.929025] systemd[1]: Finished NixOS Activation.634gitlab # [ 4.931166] systemd[1]: Starting Switch Root...635gitlab # [ 4.987784] systemd[1]: Switching root.636gitlab # [ 5.127996] systemd-journald[94]: Received SIGTERM from PID 1 (systemd).637gitlab # [ 5.777756] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)638gitlab # [ 5.777910] systemd[1]: Detected virtualization qemu.639gitlab # [ 5.777997] systemd[1]: Detected architecture arm64.640gitlab # [ 5.778186] systemd[1]: Detected first boot.641gitlab # [ 5.779672] systemd[1]: Initializing machine ID from random generator.642gitlab # [ 6.058511] systemd[1]: bpf-restrict-fs: LSM BPF program attached643gitlab # [ 6.207336] systemd[1]: Applying preset policy.644gitlab # [ 6.443739] systemd[1]: Populated /etc with preset unit settings.645gitlab # [ 6.619732] systemd[1]: initrd-switch-root.service: Deactivated successfully.646gitlab # [ 6.620033] systemd[1]: Stopped initrd-switch-root.service.647gitlab # [ 6.621543] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.648gitlab # [ 6.629528] systemd[1]: Created slice Slice /system/getty.649gitlab # [ 6.633156] systemd[1]: Created slice GitLab DevOps Platform Slice.650gitlab # [ 6.636834] systemd[1]: Created slice User and Session Slice.651gitlab # [ 6.637435] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.652gitlab # [ 6.638229] systemd[1]: Started Forward Password Requests to Wall Directory Watch.653gitlab # [ 6.639892] systemd[1]: Expecting device /dev/hvc0...654gitlab # [ 6.640835] systemd[1]: Expecting device /dev/ttyAMA0...655gitlab # [ 6.641579] systemd[1]: Reached target Local Encrypted Volumes.656gitlab # [ 6.642301] systemd[1]: Stopped target initrd-fs.target.657gitlab # [ 6.643244] systemd[1]: Stopped target initrd-root-fs.target.658gitlab # [ 6.644365] systemd[1]: Stopped target initrd-switch-root.target.659gitlab # [ 6.645688] systemd[1]: Reached target Virtual Machines and Containers.660gitlab # [ 6.646885] systemd[1]: Reached target Path Units.661gitlab # [ 6.648055] systemd[1]: Reached target Remote File Systems.662gitlab # [ 6.649207] systemd[1]: Reached target Slice Units.663gitlab # [ 6.650335] systemd[1]: Reached target Swaps.664gitlab # [ 6.654526] systemd[1]: Listening on Query the User Interactively for a Password.665gitlab # [ 6.659083] systemd[1]: Listening on Process Core Dump Socket.666gitlab # [ 6.662301] systemd[1]: Listening on Credential Encryption/Decryption.667gitlab # [ 6.666094] systemd[1]: Listening on Factory Reset Management.668gitlab # [ 6.667537] systemd[1]: Listening on Hostname Service Socket.669gitlab # [ 6.678226] systemd[1]: Starting Journal Log Access Socket...670gitlab # [ 6.681542] systemd[1]: Listening on Journal Audit Socket.671gitlab # [ 6.685905] systemd[1]: Listening on Console Output Muting Service Socket.672gitlab # [ 6.687694] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.673gitlab # [ 6.688997] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os674gitlab # [ 6.690134] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki675gitlab # [ 6.693455] systemd[1]: Listening on Disk Repartitioning Service Socket.676gitlab # [ 6.694163] systemd[1]: Listening on udev Control Socket.677gitlab # [ 6.695020] systemd[1]: Listening on udev Varlink Socket.678gitlab # [ 6.738991] systemd[1]: Mounting Huge Pages File System...679gitlab # [ 6.743826] systemd[1]: Mounting POSIX Message Queue File System...680gitlab # [ 6.748849] systemd[1]: Mounting Kernel Debug File System...681gitlab # [ 6.754826] systemd[1]: Mounting Kernel Trace File System...682gitlab # [ 6.762777] systemd[1]: Starting Create List of Static Device Nodes...683gitlab # [ 6.771033] systemd[1]: Starting Load Kernel Module 9pnet_virtio...684gitlab # [ 6.772697] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs685gitlab # [ 6.793385] systemd[1]: Mounting Kernel Configuration File System...686gitlab # [ 6.794686] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm687gitlab # [ 6.796055] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore688gitlab # [ 6.813897] systemd[1]: Starting Load Kernel Module fuse...689gitlab # [ 6.814427] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67690gitlab # [ 6.823464] systemd[1]: Starting Journal Service...691gitlab # [ 6.826988] systemd[1]: Starting Load Kernel Modules...692gitlab # [ 6.834743] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...693gitlab # [ 6.842823] systemd[1]: Starting Remount Root and Kernel File Systems...694gitlab # [ 6.843386] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os695gitlab # [ 6.853624] fuse: init (API version 7.45)696gitlab # [ 6.858682] systemd[1]: Starting Coldplug All udev Devices...697gitlab # [ 6.867644] systemd[1]: Listening on Journal Log Access Socket.698gitlab # [ 6.869207] systemd[1]: Mounted Huge Pages File System.699gitlab # [ 6.873299] systemd[1]: Mounted POSIX Message Queue File System.700gitlab # [ 6.874268] systemd-journald[315]: Collecting audit messages is enabled.701gitlab # [ 6.880009] systemd[1]: Mounted Kernel Debug File System.702gitlab # [ 6.882916] systemd[1]: Mounted Kernel Trace File System.703gitlab # [ 6.883886] systemd[1]: Finished Create List of Static Device Nodes.704gitlab # [ 6.884769] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.705gitlab # [ 6.885527] systemd[1]: Finished Load Kernel Module 9pnet_virtio.706gitlab # [ 6.886218] systemd[1]: Mounted Kernel Configuration File System.707gitlab # [ 6.887764] systemd[1]: modprobe@fuse.service: Deactivated successfully.708gitlab # [ 6.888537] systemd[1]: Finished Load Kernel Module fuse.709gitlab # [ 6.894688] systemd[1]: Mounting FUSE Control File System...710gitlab # [ 6.906417] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...711gitlab # [ 6.906830] EXT4-fs (vda): re-mounted fb97106f-1ef6-4ea6-bc56-56779bd3388a.712gitlab # [ 6.907221] systemd[1]: Queued start job for default target Multi-User System.713gitlab # [ 6.916646] systemd[1]: Started Journal Service.714gitlab # [ 6.912277] systemd[1]: Unnecessary job was removed for /dev/vdb.715gitlab # [ 6.918257] systemd[1]: systemd-journald.service: Deactivated successfully.716gitlab # [ 6.920347] systemd-modules-load[316]: Using 3 probe threads717gitlab # [ 6.921698] systemd-modules-load[316]: Module 'atkbd' is built in718gitlab # [ 6.923104] systemd-modules-load[316]: Module 'loop' is built in719gitlab # [ 6.924494] systemd-modules-load[316]: Inserted module 'tls'720gitlab # [ 6.936955] systemd-oomd[317]: No swap; memory pressure usage will be degraded721gitlab # [ 6.948504] systemd[1]: Finished Remount Root and Kernel File Systems.722gitlab # [ 6.950742] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.723gitlab # [ 6.953902] systemd[1]: Finished Load Kernel Modules.724gitlab # [ 6.956432] systemd[1]: Mounted FUSE Control File System.725gitlab # [ 6.964348] systemd[1]: Listening on Disk Image Download Service Socket.726gitlab # [ 6.967837] systemd[1]: Starting Firewall...727gitlab # [ 6.977018] systemd[1]: Starting Flush Journal to Persistent Storage...728gitlab # [ 6.979111] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore729gitlab # [ 6.994955] systemd[1]: Starting Load/Save OS Random Seed...730gitlab # [ 7.003707] systemd[1]: Starting Apply Kernel Variables...731gitlab # [ 7.007547] systemd-journald[315]: Received client request to flush runtime journal.732gitlab # [ 7.045044] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os733gitlab # [ 7.046706] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.734gitlab # [ 7.048402] systemd[1]: Starting Create Static Device Nodes in /dev...735gitlab # [ 7.049578] systemd[1]: Finished Create Static Device Nodes in /dev.736gitlab # [ 7.050731] systemd[1]: Reached target Preparation for Local File Systems.737gitlab # [ 7.052439] systemd[1]: Starting Rule-based Manager for Device Events and Files...738gitlab # [ 7.053662] systemd[1]: Finished Apply Kernel Variables.739gitlab # [ 7.054494] systemd[1]: Finished Load/Save OS Random Seed.740gitlab # [ 7.055326] systemd[1]: Reached target First Boot Complete.741gitlab # [ 7.056248] systemd[1]: Finished Flush Journal to Persistent Storage.742gitlab # [ 7.104948] systemd-udevd[348]: Using default interface naming scheme 'v261'.743gitlab # [ 7.148371] systemd[1]: Started Rule-based Manager for Device Events and Files.744gitlab # [ 7.516350] systemd[1]: Finished Coldplug All udev Devices.745gitlab # [ 7.531026] systemd[1]: Finished Firewall.746gitlab # [ 7.600465] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs747gitlab # [ 7.635326] systemd[1]: Mounting /run/wrappers...748gitlab # [ 7.668741] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.749gitlab # [ 7.678099] systemd[1]: Mounted /run/wrappers.750gitlab # [ 7.684543] systemd[1]: Reached target Local File Systems.751gitlab # [ 7.688271] (udev-worker)[388]: Network interface NamePolicy= disabled on kernel command line.752gitlab # [ 7.691734] systemd[1]: Listening on Boot Loader Control Service Socket.753gitlab # [ 7.693006] systemd[1]: Starting register-nix-paths.service...754gitlab # [ 7.696297] systemd[1]: Starting Create SUID/SGID Wrappers...755gitlab # [ 7.697466] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.756gitlab # [ 7.702816] systemd[1]: Starting Save Transient machine-id to Disk...757gitlab # [ 7.719382] (udev-worker)[469]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.758gitlab # [ 7.721910] (udev-worker)[469]: Network interface NamePolicy= disabled on kernel command line.759gitlab # [ 7.731290] systemd[1]: Starting Create System Files and Directories...760gitlab # [ 7.736360] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped.761gitlab # [ 7.774852] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.762gitlab # [ 7.776293] systemd[1]: Finished Save Transient machine-id to Disk.763gitlab # [ 7.782928] systemd[1]: Finished Create System Files and Directories.764gitlab # [ 7.788079] systemd[1]: Starting Rebuild Journal Catalog...765gitlab # [ 7.795782] systemd[1]: Starting Record System Boot/Shutdown in UTMP...766gitlab # [ 7.797346] systemd[1]: Condition check resulted in Virtio network device being skipped.767gitlab # [ 7.799028] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore768gitlab # [ 7.801336] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.769gitlab # [ 7.807101] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67770gitlab # [ 7.810130] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore771gitlab # [ 7.814690] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os772gitlab # [ 7.816647] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os773gitlab # [ 7.839823] systemd[1]: Finished Record System Boot/Shutdown in UTMP.774gitlab # [ 7.867414] systemd[1]: Finished Rebuild Journal Catalog.775gitlab # [ 7.920171] systemd[1]: Starting Update is Completed...776gitlab # [ 7.935438] mousedev: PS/2 mouse device common for all mice777gitlab # [ 7.950479] systemd[1]: Finished Update is Completed.778gitlab # [ 7.982636] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.779gitlab # [ 7.984893] systemd[1]: Finished Create SUID/SGID Wrappers.780gitlab # [ 7.986065] systemd[1]: suid-sgid-wrappers.service: Consumed 169ms CPU time over 285ms wall clock time, 6.2M memory peak, 1.9M read from disk.781gitlab # [ 8.271822] systemd[1]: Finished register-nix-paths.service.782gitlab # [ 8.272958] systemd[1]: Reached target System Initialization.783gitlab # [ 8.275000] systemd[1]: Started Discard unused filesystem blocks once a week.784gitlab # [ 8.277639] systemd[1]: Started logrotate.timer.785gitlab # [ 8.278437] systemd[1]: Started Daily Cleanup of Temporary Directories.786gitlab # [ 8.279373] systemd[1]: Reached target Timer Units.787gitlab # [ 8.280308] systemd[1]: Listening on D-Bus System Message Bus Socket.788gitlab # [ 8.281196] systemd[1]: Listening on Nix Daemon Socket.789gitlab # [ 8.293529] systemd[1]: Starting nixbot CI service socket...790gitlab # [ 8.297831] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3791gitlab # [ 8.300244] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.792gitlab # [ 8.301534] systemd[1]: Listening on nixbot CI service socket.793gitlab # [ 8.302379] systemd[1]: Reached target Socket Units.794gitlab # [ 8.304267] systemd[1]: Starting D-Bus System Message Bus...795gitlab # [ 8.357512] dbus-broker-launch[561]: Looking up NSS user entry for 'systemd-timesync'...796gitlab # [ 8.359739] dbus-broker-launch[561]: NSS returned no entry for 'systemd-timesync'797gitlab # [ 8.361071] dbus-broker-launch[561]: Invalid user-name in /nix/store/9zcyylhndlnizbwn48627991zr1jxg4p-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"798gitlab # [ 8.364115] systemd[1]: Started D-Bus System Message Bus.799gitlab # [ 8.379932] dbus-broker-launch[561]: Ready800gitlab # [ 8.380945] systemd[1]: Reached target Basic System.801gitlab # [ 8.387395] systemd[1]: Started backdoor.service.802gitlab # [ 8.388342] systemd[1]: Starting gitlab-config.service...803gitlab # [ 8.392197] systemd[1]: Starting Import lastlog data into lastlog2 database...804gitlab # [ 8.405229] systemd[1]: Starting Logrotate configuration check...805gitlab # [ 8.407537] systemd[1]: Starting Name Service Cache Daemon (nsncd)...806gitlab # [ 8.412753] systemd[1]: Starting Post-Boot Actions...807gitlab # [ 8.420578] systemd[1]: Started Reset console on configuration changes.808gitlab # [ 8.432259] logrotate[568]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.809gitlab # [ 8.436368] logrotate[568]: reading config file /nix/store/22afkmbkaxyx50bj9lbkkpmz7pd69hsf-logrotate.conf810gitlab # connecting to host...811gitlab # [ 8.437786] logrotate[568]: note: 'monthly' overrides previously specified 'weekly'812gitlab # [ 8.441061] logrotate[568]: Reading state from file: /var/lib/logrotate.status813gitlab # [ 8.444359] logrotate[568]: state file /var/lib/logrotate.status does not exist814gitlab # [ 8.445450] logrotate[568]: Allocating hash table for state file, size 64 entries815gitlab # [ 8.446432] logrotate[568]: Handling 4 logs816gitlab # [ 8.447026] logrotate[568]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed817gitlab # [ 8.450461] logrotate[568]: considering log /var/log/btmp818gitlab # [ 8.451301] logrotate[568]: Creating new state819gitlab # [ 8.451924] logrotate[568]: Now: 2026-08-20 05:53820gitlab # [ 8.456195] logrotate[568]: Last rotated at 2026-08-20 05:00821gitlab # [ 8.457051] logrotate[568]: log does not need rotating (log has already been rotated)822gitlab # [ 8.458094] logrotate[568]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed823gitlab: Guest shell says: b'Spawning backdoor root shell...\n'824gitlab # [ 8.460371] logrotate[568]: considering log /var/log/wtmp825gitlab # [ 8.461050] logrotate[568]: Creating new state826gitlab # [ 8.461622] logrotate[568]: Now: 2026-08-20 05:53827gitlab: connected to guest root shell828gitlab # [ 8.462219] logrotate[568]: Last rotated at 2026-08-20 05:00829gitlab: (connecting took 8.90 seconds)830gitlab # [ 8.462918] logrotate[568]: log does not need rotating (log has already been rotated)831gitlab: (finished: waiting for the VM to finish booting, in 8.91 seconds)832gitlab # [ 8.463847] logrotate[568]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed833gitlab # [ 8.467263] logrotate[568]: switching euid from 0 to 165 and egid from 0 to 165 (pid 568)834gitlab # [ 8.468375] logrotate[568]: considering log /var/gitlab/state/log/*.log835gitlab # [ 8.469157] logrotate[568]: log /var/gitlab/state/log/*.log does not exist -- skipping836gitlab # [ 8.470101] logrotate[568]: Creating new state837gitlab # [ 8.470683] logrotate[568]: switching euid from 165 to 0 and egid from 165 to 0 (pid 568)838gitlab # [ 8.472275] logrotate[568]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed839gitlab # [ 8.473803] logrotate[568]: switching euid from 0 to 60 and egid from 0 to 60 (pid 568)840gitlab # [ 8.474736] logrotate[568]: considering log /var/log/nginx/*.log841gitlab # [ 8.475447] logrotate[568]: log /var/log/nginx/*.log does not exist -- skipping842gitlab # [ 8.476841] logrotate[568]: Creating new state843gitlab # [ 8.477481] logrotate[568]: not running postrotate script, since no logs were rotated844gitlab # [ 8.478524] logrotate[568]: switching euid from 60 to 0 and egid from 60 to 0 (pid 568)845gitlab # [ 8.480646] nsncd[571]: Aug 20 05:53:15.267 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"846gitlab # [ 8.486011] systemd[1]: Starting resolvconf update...847gitlab # [ 8.487079] systemd[1]: Finished Logrotate configuration check.848gitlab # [ 8.489793] systemd[1]: Finished Post-Boot Actions.849gitlab # [ 8.490819] systemd[1]: Finished Import lastlog data into lastlog2 database.850gitlab # [ 8.491892] systemd[1]: Started Name Service Cache Daemon (nsncd).851gitlab # [ 8.493121] systemd[1]: Reached target Host and Network Name Lookups.852gitlab # [ 8.494503] systemd[1]: Reached target User and Group Name Lookups.853gitlab # [ 8.495717] systemd[1]: Starting User Login Management...854gitlab # [ 8.497478] systemd[1]: Starting Virtual Console Setup...855gitlab # [ 8.549884] systemd-logind[608]: New seat seat0.856gitlab # [ 8.554748] systemd[1]: Stopped target Host and Network Name Lookups.857gitlab # [ 8.555794] systemd[1]: Stopping Host and Network Name Lookups...858gitlab # [ 8.556846] systemd[1]: Stopped target User and Group Name Lookups.859gitlab # [ 8.559809] systemd[1]: Stopping User and Group Name Lookups...860gitlab # [ 8.564503] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...861gitlab # [ 8.565478] systemd-logind[608]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)862gitlab # [ 8.566762] systemd-logind[608]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)863gitlab # [ 8.571773] systemd-logind[608]: Watching system buttons on /dev/input/event0 (gpio-keys)864gitlab # [ 8.573072] systemd[1]: Started User Login Management.865gitlab # [ 8.573960] systemd[1]: Starting linger-users.service...866gitlab # [ 8.574719] systemd[1]: nscd.service: Deactivated successfully.867gitlab # [ 8.575692] systemd[1]: Stopped Name Service Cache Daemon (nsncd).868gitlab # [ 8.576774] systemd[1]: nscd.service: Consumed 28ms CPU time over 153ms wall clock time, 7.5M memory peak, 5.8M read from disk.869gitlab # [ 8.578795] systemd-vconsole-setup[610]: Configuration of first virtual console was skipped, ignoring remaining ones.870gitlab # [ 8.586523] systemd[1]: Starting Name Service Cache Daemon (nsncd)...871gitlab # [ 8.589083] systemd[1]: Finished Virtual Console Setup.872gitlab # [ 8.596744] systemd[1]: linger-users.service: Deactivated successfully.873gitlab # [ 8.597813] systemd[1]: Finished linger-users.service.874gitlab # [ 8.598679] systemd[1]: Finished resolvconf update.875gitlab # [ 8.600359] systemd[1]: Reached target Preparation for Network.876gitlab # [ 8.606118] systemd[1]: Starting DHCP Client...877gitlab # [ 8.608180] systemd[1]: Starting Address configuration of eth1...878gitlab # [ 8.612162] systemd[1]: Starting Extra networking commands....879gitlab # [ 8.617227] nsncd[673]: Aug 20 05:53:15.408 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"880gitlab # [ 8.622377] systemd[1]: Started Name Service Cache Daemon (nsncd).881gitlab # [ 8.626472] systemd[1]: Reached target Host and Network Name Lookups.882gitlab # [ 8.627500] systemd[1]: Reached target User and Group Name Lookups.883gitlab # [ 8.645221] network-addresses-eth1-start[682]: adding address 192.168.1.1/24... done884gitlab # [ 8.648850] network-addresses-eth1-start[682]: adding address 2001:db8:1::1/64... done885gitlab # [ 8.658059] systemd[1]: Finished Address configuration of eth1.886gitlab # [ 8.695349] dhcpcd[701]: dhcpcd-10.3.2 starting887gitlab # [ 8.698117] dhcpcd[755]: dev: loaded udev888gitlab # [ 8.700877] systemd[1]: Finished Extra networking commands..889gitlab # [ 8.702424] systemd[1]: Reached target Network.890gitlab # [ 8.707080] systemd[1]: Starting gitlab-workhorse.service...891gitlab # [ 8.712174] 8021q: 802.1Q VLAN Support v1.8892gitlab # [ 8.712604] 8021q: adding VLAN 0 to HW filter on device eth1893gitlab # [ 8.713535] systemd[1]: Starting Nginx Web Server...894gitlab # [ 8.720462] systemd[1]: Starting PostgreSQL Server...895gitlab # [ 8.729470] systemd[1]: Starting Redis Server - redis-gitlab...896gitlab # [ 8.732713] systemd[1]: Starting Permit User Sessions...897gitlab # [ 8.745167] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.898gitlab # [ 8.755325] cfg80211: Loading compiled-in X.509 certificates for regulatory database899gitlab # [ 8.762835] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'900gitlab # [ 8.763343] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'901gitlab # [ 8.766214] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2902gitlab # [ 8.766582] cfg80211: failed to load regulatory.db903gitlab # [ 8.773633] systemd[1]: Finished Permit User Sessions.904gitlab # [ 8.777246] systemd[1]: Started Getty on tty1.905gitlab # [ 8.783078] systemd[1]: Reached target Login Prompts.906gitlab # [ 8.806714] 8021q: adding VLAN 0 to HW filter on device eth0907gitlab # [ 8.805254] dhcpcd[755]: eth0: waiting for carrier908gitlab # [ 8.808291] dhcpcd[755]: eth0: carrier acquired909gitlab # [ 8.811777] dhcpcd[755]: DUID 00:01:00:01:32:19:52:cb:52:54:00:12:34:56910gitlab # [ 8.816050] dhcpcd[755]: eth0: IAID 00:12:34:56911gitlab # [ 8.816724] dhcpcd[755]: eth0: adding address fe80::5054:ff:fe12:3456912gitlab # [ 8.910774] nginx-pre-start[795]: nginx: the configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf syntax is ok913gitlab # [ 8.912862] nginx-pre-start[795]: nginx: configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf test is successful914gitlab # [ 8.917823] systemd[1]: Started Nginx Web Server.915gitlab # [ 8.922806] redis-server[792]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.916gitlab # [ 8.926916] redis-server[792]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo917gitlab # [ 8.928131] systemd[1]: Started Redis Server - redis-gitlab.918gitlab # [ 8.929008] redis-server[792]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=792, just started919gitlab # [ 8.930594] redis-server[792]: Configuration loaded920gitlab # [ 8.931428] redis[792]: monotonic clock: ARM CNTVCT @ 1000 ticks/us921gitlab # [ 8.933873] redis[792]: Running mode=standalone, port=0.922gitlab # [ 8.934737] redis[792]: Server initialized923gitlab # [ 8.935621] redis[792]: Ready to accept connections unix924gitlab # [ 8.936662] redis[792]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.925gitlab # [ 8.938959] postgresql-pre-start[794]: The files belonging to this database system will be owned by user "postgres".926gitlab # [ 8.941004] postgresql-pre-start[794]: This user must also own the server process.927gitlab # [ 8.942074] postgresql-pre-start[794]: The database cluster will be initialized with locale "en_US.UTF-8".928gitlab # [ 8.943379] postgresql-pre-start[794]: The default database encoding has accordingly been set to "UTF8".929gitlab # [ 8.944814] postgresql-pre-start[794]: The default text search configuration will be set to "english".930gitlab # [ 8.946096] postgresql-pre-start[794]: Data page checksums are enabled.931gitlab # [ 8.947045] postgresql-pre-start[794]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok932gitlab # [ 8.948517] postgresql-pre-start[794]: creating subdirectories ... ok933gitlab # [ 8.949378] postgresql-pre-start[794]: selecting dynamic shared memory implementation ... posix934gitlab # [ 8.985203] postgresql-pre-start[794]: selecting default "max_connections" ... 100935gitlab # [ 9.048002] postgresql-pre-start[794]: selecting default "shared_buffers" ... 128MB936gitlab # [ 9.533167] systemd[1]: Started gitlab-workhorse.service.937gitlab # [ 9.542208] postgresql-pre-start[794]: selecting default time zone ... UTC938gitlab # [ 9.547369] postgresql-pre-start[794]: creating configuration files ... ok939gitlab # [ 9.786080] postgresql-pre-start[794]: running bootstrap script ... ok940gitlab # [ 9.895597] dhcpcd[755]: eth0: soliciting a DHCP lease941gitlab # [ 9.908929] dhcpcd[755]: eth0: offered 10.0.2.15 from 10.0.2.2942gitlab # [ 9.924600] dhcpcd[755]: eth0: probing address 10.0.2.15/24943gitlab # [ 9.981153] gitlab-workhorse[818]: time="2026-08-20T05:53:16Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4944gitlab # [ 9.986637] gitlab-workhorse[818]: time="2026-08-20T05:53:16Z" level=info msg="Using redis/go-redis"945gitlab # [ 9.991177] gitlab-workhorse[818]: time="2026-08-20T05:53:16Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix946gitlab # [ 10.446814] postgresql-pre-start[794]: performing post-bootstrap initialization ... ok947gitlab # [ 10.812491] postgresql-pre-start[794]: syncing data to disk ... ok948gitlab # [ 10.815253] postgresql-pre-start[794]: initdb: warning: enabling "trust" authentication for local connections949gitlab # [ 10.819416] postgresql-pre-start[794]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.950gitlab # [ 10.825984] postgresql-pre-start[794]: Success. You can now start the database server using:951gitlab # [ 10.829443] postgresql-pre-start[794]: pg_ctl -D /var/lib/postgresql/18 -l logfile start952gitlab # [ 10.968284] dhcpcd[755]: eth0: soliciting an IPv6 router953gitlab # [ 10.970971] dhcpcd[755]: eth0: Router Advertisement from fe80::2954gitlab # [ 10.975223] dhcpcd[755]: eth0: adding address fec0::5054:ff:fe12:3456/64955gitlab # [ 10.978185] dhcpcd[755]: eth0: adding route to fec0::/64956gitlab # [ 10.980525] dhcpcd[755]: eth0: adding default route via fe80::2957gitlab # [ 11.043845] postgres[852]: [852] LOG: starting PostgreSQL 18.4 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit958gitlab # [ 11.047962] postgres[852]: [852] LOG: listening on IPv6 address "::1", port 5432959gitlab # [ 11.050307] postgres[852]: [852] LOG: listening on IPv4 address "127.0.0.1", port 5432960gitlab # [ 11.053020] postgres[852]: [852] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"961gitlab # [ 11.062230] postgres[865]: [865] LOG: database system was shut down at 2026-08-20 05:53:17 GMT962gitlab # [ 11.075345] postgres[852]: [852] LOG: database system is ready to accept connections963gitlab # [ 11.079274] systemd[1]: Started PostgreSQL Server.964gitlab # [ 11.087094] systemd[1]: Starting PostgreSQL Setup Scripts...965gitlab # [ 11.284621] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[859]: mkdir -p /var/gitlab/state/home/.ssh: OK966gitlab # [ 11.288799] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[859]: chmod 700 /var/gitlab/state/home/.ssh: OK967gitlab # [ 11.390606] systemd[1]: Finished gitlab-config.service.968gitlab # [ 11.396328] systemd[1]: Started gitaly.service.969gitlab # [ 11.499058] postgresql-setup-start[877]: CREATE DATABASE970gitlab # [ 11.561931] postgresql-setup-start[896]: CREATE ROLE971gitlab # [ 11.589261] postgresql-setup-start[898]: ALTER DATABASE972gitlab # [ 11.649981] postgresql-setup-start[903]: CREATE ROLE973gitlab # [ 11.653239] systemd[1]: Finished PostgreSQL Setup Scripts.974gitlab # [ 11.655732] systemd[1]: Reached target PostgreSQL.975gitlab # [ 11.660867] systemd[1]: Starting gitlab-db-config.service...976gitlab # [ 11.668240] systemd[1]: Starting gitlab-postgresql.service...977gitlab # [ 11.899644] gitlab-postgresql-start[922]: CREATE DATABASE978gitlab # [ 11.969034] gitlab-postgresql-start[934]: CREATE EXTENSION979gitlab # [ 12.093232] gitlab-postgresql-start[936]: CREATE EXTENSION980gitlab # [ 12.101865] systemd[1]: Finished gitlab-postgresql.service.981gitlab # [ 12.359821] gitaly[891]: time="2026-08-20T05:53:19.151Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/0r0qd84zrxhqq373hk9spv8j9pg0qlnq-gitaly.toml' and fix the errors that are printed." pid=891982gitlab # [ 12.371485] gitaly[891]: time="2026-08-20T05:53:19.151Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=891983gitlab # [ 12.376933] gitaly[891]: time="2026-08-20T05:53:19.151Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=891984gitlab # [ 12.383998] gitaly[891]: time="2026-08-20T05:53:19.152Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=891985gitlab # [ 12.389840] gitaly[891]: time="2026-08-20T05:53:19.152Z" level=info msg="Starting Gitaly" pid=891 version=986gitlab # [ 12.602243] gitaly[891]: time="2026-08-20T05:53:19.394Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=241 pid=891987gitlab # [ 12.604858] gitaly[891]: time="2026-08-20T05:53:19.394Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=891988gitlab # [ 12.607091] gitaly[891]: time="2026-08-20T05:53:19.395Z" level=info msg="finished initializing command factory" duration_ms=0 pid=891989gitlab # [ 12.609304] gitaly[891]: time="2026-08-20T05:53:19.395Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-891/git-exec-2843050631.d/git pid=891990gitlab # [ 12.612383] gitaly[891]: time="2026-08-20T05:53:19.404Z" level=info msg="finished detecting git version" duration_ms=9 pid=891991gitlab # [ 12.615155] gitaly[891]: time="2026-08-20T05:53:19.404Z" level=info msg="using Git version" pid=891 version=2.53.g992gitlab # [ 12.616670] gitaly[891]: time="2026-08-20T05:53:19.405Z" level=info msg="clearing disk cache object folder" pid=891 storage=default993gitlab # [ 12.618133] gitaly[891]: time="2026-08-20T05:53:19.405Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2720393154 pid=891 storage=default994gitlab # [ 12.620419] gitaly[891]: time="2026-08-20T05:53:19.405Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2720393154 pid=891 storage=default995gitlab # [ 12.623189] gitaly[891]: time="2026-08-20T05:53:19.405Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=891996gitlab # [ 12.626191] gitaly[891]: time="2026-08-20T05:53:19.405Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=891997gitlab # [ 12.630382] gitaly[891]: time="2026-08-20T05:53:19.405Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2720393154 clear_duration_ms=0 pid=891 storage=default998gitlab # [ 12.633308] gitaly[891]: time="2026-08-20T05:53:19.420Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=891999gitlab # [ 12.635627] gitaly[891]: time="2026-08-20T05:53:19.421Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=891 schema=unix1000gitlab # [ 12.637903] gitaly[891]: time="2026-08-20T05:53:19.421Z" level=info msg="listening at address" address=/run/gitaly/gitaly-891/sock.d/intern pid=891 schema=unix1001gitlab # [ 12.639973] gitaly[891]: time="2026-08-20T05:53:19.422Z" level=info msg="finished tempdir cleaner walk" pid=891 storage=default time_ms=01002gitlab # [ 12.641906] gitaly[891]: time="2026-08-20T05:53:19.422Z" level=info msg="counting repositories" pid=8911003gitlab # [ 12.643244] gitaly[891]: time="2026-08-20T05:53:19.422Z" level=info msg="starting to count repositories" pid=891 storage_path=/var/gitlab/state/repositories1004gitlab # [ 12.645390] gitaly[891]: time="2026-08-20T05:53:19.422Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=891 storage_path=/var/gitlab/state/repositories1005gitlab # [ 12.647780] gitaly[891]: time="2026-08-20T05:53:19.422Z" level=info msg="completed counting all repositories" counting_duration=0 pid=8911006gitlab # [ 12.649740] gitaly[891]: time="2026-08-20T05:53:19.423Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=8911007gitlab # [ 12.651447] gitaly[891]: time="2026-08-20T05:53:19.423Z" level=info msg="Started Gitaly" duration_ms=271 pid=8911008gitlab # [ 12.653054] gitaly[891]: time="2026-08-20T05:53:19.423Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=8911009gitlab # [ 12.654809] gitaly[891]: time="2026-08-20T05:53:19.423Z" level=info msg="maintenance: daily scheduled" pid=891 scheduled="2026-08-20 12:00:00 +0000 UTC"1010gitlab # [ 13.503550] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[912]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1011gitlab # [ 13.507791] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[912]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1012gitlab # [ 13.539268] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[912]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1013gitlab # [ 15.619714] dhcpcd[755]: eth0: leased 10.0.2.15 for 86400 seconds1014gitlab # [ 15.622648] dhcpcd[755]: eth0: adding route to 10.0.2.0/241015gitlab # [ 15.625692] dhcpcd[755]: eth0: adding default route via 10.0.2.21016gitlab # [ 15.866928] systemd[1]: Started DHCP Client.1017gitlab # [ 15.870300] systemd[1]: Reached target Network is Online.1018gitlab # [ 16.735770] gitaly[891]: time="2026-08-20T05:53:23.525Z" level=info msg="License database preloaded" duration_ms=4373 pid=8911019gitlab # [ 62.436155] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[912]: W, [2026-08-20T05:54:09.227072 #912] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1020gitlab # [ 65.646258] postgres[1471]: [1471] ERROR: relation "feature_gates" does not exist at character 5231021gitlab # [ 65.646753] postgres[1471]: [1471] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1022gitlab # [ 65.646893] postgres[1471]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1023gitlab # [ 65.647001] postgres[1471]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1024gitlab # [ 65.647121] postgres[1471]: attidentity AS identity,1025gitlab # [ 65.647240] postgres[1471]: attgenerated as attgenerated1026gitlab # [ 65.647370] postgres[1471]: FROM pg_attribute a1027gitlab # [ 65.647494] postgres[1471]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1028gitlab # [ 65.647639] postgres[1471]: LEFT JOIN pg_type t ON a.atttypid = t.oid1029gitlab # [ 65.647757] postgres[1471]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1030gitlab # [ 65.647874] postgres[1471]: WHERE a.attrelid = '"feature_gates"'::regclass1031gitlab # [ 65.647993] postgres[1471]: AND a.attnum > 0 AND NOT a.attisdropped1032gitlab # [ 65.683963] postgres[1471]: ORDER BY a.attnum1033gitlab # [ 65.686169] postgres[1471]:1034gitlab # [ 70.054041] gitlab-workhorse[818]: time="2026-08-20T05:54:16Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1035gitlab # [ 70.878100] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1522]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1036gitlab # [ 70.880577] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1522]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1037gitlab # [ 80.062291] gitlab-workhorse[818]: time="2026-08-20T05:54:26Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1038gitlab # [ 90.076847] gitlab-workhorse[818]: time="2026-08-20T05:54:36Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1039gitlab # [ 99.817481] postgres[1625]: [1625] ERROR: relation "table_without_models" does not exist1040gitlab # [ 99.818131] postgres[1625]: [1625] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1041gitlab # [ 100.086342] gitlab-workhorse[818]: time="2026-08-20T05:54:46Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1042gitlab # [ 110.094498] gitlab-workhorse[818]: time="2026-08-20T05:54:56Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1043gitlab # [ 120.102371] gitlab-workhorse[818]: time="2026-08-20T05:55:06Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1044gitlab # [ 130.108694] gitlab-workhorse[818]: time="2026-08-20T05:55:16Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1045gitlab # [ 130.536543] systemd[1]: Finished gitlab-db-config.service.1046gitlab # [ 130.543888] systemd[1]: Started gitlab-sidekiq.service.1047gitlab # [ 130.549388] systemd[1]: Starting gitlab.service...1048gitlab # [ 131.133888] bundle[2028]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1049gitlab # [ 131.144660] bundle[2028]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1050gitlab # [ 131.156286] bundle[2028]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1051gitlab # [ 135.714000] sidekiq-cluster[2027]: {"severity":"INFO","time":"2026-08-20T05:55:22.463Z","message":"Starting cluster with 1 processes"}1052gitlab # [ 135.955020] bundle[2028]: {"timestamp":"2026-08-20T05:55:22.708Z","pid":2028,"message":"* Enabling systemd notification integration"}1053gitlab # [ 135.960313] bundle[2028]: {"timestamp":"2026-08-20T05:55:22.746Z","pid":2028,"message":"Puma starting in cluster mode..."}1054gitlab # [ 135.964716] bundle[2028]: {"timestamp":"2026-08-20T05:55:22.746Z","pid":2028,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1055gitlab # [ 135.969607] bundle[2028]: {"timestamp":"2026-08-20T05:55:22.746Z","pid":2028,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1056gitlab # [ 135.975447] bundle[2028]: {"timestamp":"2026-08-20T05:55:22.746Z","pid":2028,"message":"* Min threads: 0"}1057gitlab # [ 135.979447] bundle[2028]: {"timestamp":"2026-08-20T05:55:22.746Z","pid":2028,"message":"* Max threads: 4"}1058gitlab # [ 135.983458] bundle[2028]: {"timestamp":"2026-08-20T05:55:22.746Z","pid":2028,"message":"* Environment: production"}1059gitlab # [ 135.987701] bundle[2028]: {"timestamp":"2026-08-20T05:55:22.746Z","pid":2028,"message":"* Master PID: 2028"}1060gitlab # [ 135.991843] bundle[2028]: {"timestamp":"2026-08-20T05:55:22.746Z","pid":2028,"message":"* Workers: 2"}1061gitlab # [ 135.995875] bundle[2028]: {"timestamp":"2026-08-20T05:55:22.746Z","pid":2028,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1062gitlab # [ 136.002016] bundle[2028]: {"timestamp":"2026-08-20T05:55:22.746Z","pid":2028,"message":"* Preloading application"}1063gitlab # [ 140.107557] gitlab-workhorse[818]: time="2026-08-20T05:55:26Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1064gitlab # [ 150.108780] gitlab-workhorse[818]: time="2026-08-20T05:55:36Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1065gitlab # [ 160.118232] gitlab-workhorse[818]: time="2026-08-20T05:55:46Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1066gitlab # [ 170.129558] gitlab-workhorse[818]: time="2026-08-20T05:55:56Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1067gitlab # [ 175.048103] bundle[2028]: W, [2026-08-20T05:56:01.839241 #2028] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1068gitlab # [ 179.055389] sidekiq-cluster[2079]: 2026-08-20T05:56:05.846Z pid=2079 tid=xpz INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2079, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>435941376}1069gitlab # [ 179.347577] sidekiq-cluster[2079]: W, [2026-08-20T05:56:06.139865 #2079] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1070gitlab # [ 179.409254] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:06.201Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1071gitlab # [ 180.138324] gitlab-workhorse[818]: time="2026-08-20T05:56:06Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1072gitlab # [ 183.248153] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.039Z","message":"GitLab reliable fetch activated!"}1073gitlab # [ 183.248576] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.039Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1074gitlab # [ 183.283187] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.075Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1075gitlab # [ 183.290400] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.078Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1076gitlab # [ 183.297524] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.081Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1077gitlab # [ 183.304228] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.084Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1078gitlab # [ 183.311265] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.086Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1079gitlab # [ 183.316979] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.089Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1080gitlab # [ 183.322214] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.092Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1081gitlab # [ 183.326833] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.094Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1082gitlab # [ 183.331249] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.097Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1083gitlab # [ 183.335385] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.099Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1084gitlab # [ 183.339768] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.101Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1085gitlab # [ 183.343742] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.103Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1086gitlab # [ 183.348806] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.105Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1087gitlab # [ 183.352936] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.107Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1088gitlab # [ 183.357074] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.110Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1089gitlab # [ 183.361187] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.112Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1090gitlab # [ 183.365122] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.115Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1091gitlab # [ 183.369020] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.118Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1092gitlab # [ 183.373130] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.121Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1093gitlab # [ 183.376859] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.123Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1094gitlab # [ 183.380749] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.126Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1095gitlab # [ 183.384597] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.128Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1096gitlab # [ 183.387920] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.131Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1097gitlab # [ 183.391328] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.133Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1098gitlab # [ 183.394624] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.135Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1099gitlab # [ 183.397620] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.139Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1100gitlab # [ 183.400368] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.142Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1101gitlab # [ 183.403213] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.144Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1102gitlab # [ 183.406052] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.147Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1103gitlab # [ 183.408803] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.150Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1104gitlab # [ 183.411182] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.153Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1105gitlab # [ 183.413991] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.156Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1106gitlab # [ 183.416366] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.159Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1107gitlab # [ 183.418748] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.162Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1108gitlab # [ 183.421162] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.165Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1109gitlab # [ 183.423414] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.167Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1110gitlab # [ 183.425857] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.170Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1111gitlab # [ 183.428032] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.173Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1112gitlab # [ 183.430135] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.175Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1113gitlab # [ 183.432245] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.177Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1114gitlab # [ 183.434406] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.180Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1115gitlab # [ 183.436564] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.182Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1116gitlab # [ 183.438655] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.185Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1117gitlab # [ 183.440731] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.187Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1118gitlab # [ 183.442853] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.190Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1119gitlab # [ 183.445137] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.193Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1120gitlab # [ 183.447206] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.195Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1121gitlab # [ 183.449389] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.216Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1122gitlab # [ 183.451410] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.224Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1123gitlab # [ 183.453604] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.231Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1124gitlab # [ 183.455660] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.238Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1125gitlab # [ 183.457865] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.249Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1126gitlab # [ 183.485325] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.277Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1127gitlab # [ 183.493654] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.286Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1128gitlab # [ 183.507136] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.298Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1129gitlab # [ 183.514132] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.306Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1130gitlab # [ 183.519153] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.310Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1131gitlab # [ 183.524861] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.316Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1132gitlab # [ 183.529638] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.321Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1133gitlab # [ 183.535296] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.327Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1134gitlab # [ 183.540788] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.333Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1135gitlab # [ 183.545759] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.337Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1136gitlab # [ 183.556870] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.349Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1137gitlab # [ 183.562563] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.354Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1138gitlab # [ 183.567011] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.359Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1139gitlab # [ 183.571554] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.363Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1140gitlab # [ 183.575782] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.367Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1141gitlab # [ 183.580207] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.370Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1142gitlab # [ 183.584269] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.373Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1143gitlab # [ 183.588091] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.376Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1144gitlab # [ 183.591633] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.381Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1145gitlab # [ 183.595257] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.384Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1146gitlab # [ 183.598725] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.387Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1147gitlab # [ 183.602250] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.390Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1148gitlab # [ 183.605561] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.393Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1149gitlab # [ 183.608725] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.397Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1150gitlab # [ 183.611560] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.400Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1151gitlab # [ 183.614825] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.404Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1152gitlab # [ 183.617595] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.407Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1153gitlab # [ 183.620125] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.410Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1154gitlab # [ 183.622775] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.412Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1155gitlab # [ 183.625614] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.415Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1156gitlab # [ 183.628168] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.418Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1157gitlab # [ 183.630669] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.423Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1158gitlab # [ 183.635868] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.428Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1159gitlab # [ 183.638459] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.430Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1160gitlab # [ 183.641512] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.433Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1161gitlab # [ 183.643923] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.436Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1162gitlab # [ 183.646596] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.438Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1163gitlab # [ 183.649113] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.440Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1164gitlab # [ 183.651584] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.443Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1165gitlab # [ 183.654179] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.445Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1166gitlab # [ 183.656670] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.447Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1167gitlab # [ 183.659268] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.449Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1168gitlab # [ 183.661546] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.452Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1169gitlab # [ 183.664079] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.455Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1170gitlab # [ 183.666509] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.458Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1171gitlab # [ 183.669017] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.459Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1172gitlab # [ 183.681430] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.473Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1173gitlab # [ 183.684581] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.477Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1174gitlab # [ 183.687316] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.479Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1175gitlab # [ 183.690690] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.483Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1176gitlab # [ 183.694043] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.486Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1177gitlab # [ 183.697019] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.489Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1178gitlab # [ 183.763478] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.553Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1179gitlab # [ 183.769898] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.558Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1180gitlab # [ 183.775412] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.561Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1181gitlab # [ 183.781433] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.564Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1182gitlab # [ 183.787177] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:10.568Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1183gitlab # [ 190.146451] gitlab-workhorse[818]: time="2026-08-20T05:56:16Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1184gitlab # [ 200.156654] gitlab-workhorse[818]: time="2026-08-20T05:56:26Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1185gitlab # [ 210.166381] gitlab-workhorse[818]: time="2026-08-20T05:56:36Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1186gitlab # [ 220.174202] gitlab-workhorse[818]: time="2026-08-20T05:56:46Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1187gitlab # [ 224.027328] postgres[2816]: [2816] ERROR: relation "table_without_models" does not exist1188gitlab # [ 224.027759] postgres[2816]: [2816] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1189gitlab # [ 227.616257] postgres[2845]: [2845] ERROR: relation "table_without_models" does not exist1190gitlab # [ 227.616613] postgres[2845]: [2845] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1191gitlab # [ 229.239631] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:56.025Z","message":"Booted Rails 7.2.3.1 application in production environment"}1192gitlab # [ 229.241535] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:56.033Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1193gitlab # [ 229.248403] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:56.037Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1194gitlab # [ 229.253820] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:56.037Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1195gitlab # [ 229.259983] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:56.039Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1196gitlab # [ 230.194270] gitlab-workhorse[818]: time="2026-08-20T05:56:56Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1197gitlab # [ 232.099008] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:58.890Z","message":"Cleaning working queues"}1198gitlab # [ 232.103915] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:58.894Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"28dd5ac32f4667f359cee86a","created_at":"2026-08-20T05:55:16.766Z","trace_propagation_headers":{"sentry-trace":"52c6b65fdcd14559b2432bc55bcb3805-1683958fde874772","baggage":"sentry-trace_id=52c6b65fdcd14559b2432bc55bcb3805,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"aa766f53618f2d00f058d10e2efa1cf9","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:16.780Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-28dd5ac32f4667f359cee86a: start","job_status":"start","queue_duration_s":102.113917,"scheduling_latency_s":102.113977}1199gitlab # [ 232.460430] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:56:59.251Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"28dd5ac32f4667f359cee86a","created_at":"2026-08-20T05:55:16.766Z","trace_propagation_headers":{"sentry-trace":"52c6b65fdcd14559b2432bc55bcb3805-1683958fde874772","baggage":"sentry-trace_id=52c6b65fdcd14559b2432bc55bcb3805,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"aa766f53618f2d00f058d10e2efa1cf9","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:16.780Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-28dd5ac32f4667f359cee86a: done: 0.357719 sec","job_status":"done","queue_duration_s":102.113917,"scheduling_latency_s":102.113977,"redis_calls":29,"redis_duration_s":0.013013,"redis_read_bytes":282,"redis_write_bytes":3632,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.007641,"redis_feature_flag_read_bytes":272,"redis_feature_flag_write_bytes":2385,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003475,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001897,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":15,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.208413,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.20654378,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.357719,"completed_at":"2026-08-20T05:56:59.251Z","load_balancing_strategy":"primary","db_duration_s":0.103671,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1200gitlab # [ 233.653816] bundle[2028]: {"timestamp":"2026-08-20T05:57:00.444Z","pid":2028,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1201gitlab # [ 233.654235] bundle[2028]: {"timestamp":"2026-08-20T05:57:00.444Z","pid":2028,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1202gitlab # [ 233.654448] bundle[2028]: {"timestamp":"2026-08-20T05:57:00.444Z","pid":2028,"message":"! #\u003cThread:0x0000e864eeb92dc8 /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1203gitlab # [ 233.654858] bundle[2028]: {"timestamp":"2026-08-20T05:57:00.444Z","pid":2028,"message":"! #\u003cThread:0x0000e864ec458960 /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1204gitlab # [ 233.655233] bundle[2028]: {"timestamp":"2026-08-20T05:57:00.445Z","pid":2028,"message":"Use Ctrl-C to stop"}1205gitlab # [ 233.655438] bundle[2028]: {"timestamp":"2026-08-20T05:57:00.445Z","pid":2028,"message":"Sending status to systemd every 1.0 sec"}1206gitlab # [ 234.498028] bundle[2028]: {"timestamp":"2026-08-20T05:57:01.290Z","pid":2028,"message":"- Worker 0 (PID: 2964) booted in 0.8s, phase: 0"}1207gitlab # [ 234.571873] bundle[2028]: {"timestamp":"2026-08-20T05:57:01.364Z","pid":2028,"message":"- Worker 1 (PID: 2968) booted in 0.84s, phase: 0"}1208gitlab # [ 234.578884] systemd[1]: Started gitlab.service.1209gitlab # [ 234.581405] systemd[1]: Reached target Common target for all GitLab services..1210gitlab # [ 234.586608] systemd[1]: Starting setup-gitlab.service...1211gitlab # [ 234.620368] setup-gitlab-start[2996]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1212gitlab # [ 238.786406] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:05 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 41031213gitlab # [ 238.792839] setup-gitlab-start[2996]: + TOKEN=nixbot-test-token-of-20-chars1214gitlab # [ 238.793933] setup-gitlab-start[2996]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1215gitlab # [ 238.815230] runuser[3018]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1216gitlab # [ 239.390700] setup-gitlab-start[3023]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1217gitlab # [ 239.397290] setup-gitlab-start[3023]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1218gitlab # [ 239.403528] setup-gitlab-start[3023]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1219gitlab # [ 240.259752] setup-gitlab-start[3023]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1220gitlab # [ 240.266590] setup-gitlab-start[3023]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1221gitlab # [ 240.274568] setup-gitlab-start[3023]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1222gitlab # [ 246.948961] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:13.739Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"7add12b46b4551bf9f22f037","created_at":"2026-08-20T05:57:13.630Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d060b54959253bfa6de9d85586497c3f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:13.735Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-7add12b46b4551bf9f22f037: start","job_status":"start","queue_duration_s":0.003936,"scheduling_latency_s":0.004009}1223gitlab # [ 247.181556] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:13.972Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"7add12b46b4551bf9f22f037","created_at":"2026-08-20T05:57:13.630Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d060b54959253bfa6de9d85586497c3f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:13.735Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-7add12b46b4551bf9f22f037: done: 0.23284 sec","job_status":"done","queue_duration_s":0.003936,"scheduling_latency_s":0.004009,"redis_calls":12,"redis_duration_s":0.043962,"redis_read_bytes":11,"redis_write_bytes":1482,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.004023,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.03825,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001689,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.057594,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00199576,"duration_s":0.23284,"completed_at":"2026-08-20T05:57:13.971Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.03094,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1224gitlab # [ 247.280721] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:14.062Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"7e4e45438579dbb45f750478","created_at":"2026-08-20T05:57:13.755Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d17488b38baded96f2860f20e547383c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T05:57:13.787Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-7e4e45438579dbb45f750478: start","job_status":"start","queue_duration_s":0.274171,"scheduling_latency_s":0.274231}1225gitlab # [ 247.465560] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:14.256Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"7e4e45438579dbb45f750478","created_at":"2026-08-20T05:57:13.755Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d17488b38baded96f2860f20e547383c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T05:57:13.787Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-7e4e45438579dbb45f750478: done: 0.194652 sec","job_status":"done","queue_duration_s":0.274171,"scheduling_latency_s":0.274231,"redis_calls":10,"redis_duration_s":0.026417,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002584,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.019611,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004222,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.028,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.069843,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0034246,"duration_s":0.194652,"completed_at":"2026-08-20T05:57:14.256Z","load_balancing_strategy":"primary","db_duration_s":0.043806,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1226gitlab # [ 247.554435] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:14.265Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"b70c2833572a97207dd26a83","created_at":"2026-08-20T05:57:13.830Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c0b5d6620c554ba4f633c6f88c60fdfd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T05:57:13.843Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-b70c2833572a97207dd26a83: start","job_status":"start","queue_duration_s":0.422321,"scheduling_latency_s":0.422382}1227gitlab # [ 247.571241] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:14.306Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1228gitlab # [ 247.575634] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:14.332Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"b70c2833572a97207dd26a83","created_at":"2026-08-20T05:57:13.830Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c0b5d6620c554ba4f633c6f88c60fdfd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T05:57:13.843Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-b70c2833572a97207dd26a83: done: 0.066367 sec","job_status":"done","queue_duration_s":0.422321,"scheduling_latency_s":0.422382,"redis_calls":10,"redis_duration_s":0.004143,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000862,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002346,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000935,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033113,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00064004,"duration_s":0.066367,"completed_at":"2026-08-20T05:57:14.332Z","load_balancing_strategy":"primary","db_duration_s":0.001077,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1229gitlab # [ 247.618171] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:14.337Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"222e1bcd455629a45f780cd0","created_at":"2026-08-20T05:57:13.867Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1b7a93f4e24790ae8dc01dc5618bba83","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:13.898Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-222e1bcd455629a45f780cd0: start","job_status":"start","queue_duration_s":0.438728,"scheduling_latency_s":0.438774}1230gitlab # [ 247.644003] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:14.435Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"222e1bcd455629a45f780cd0","created_at":"2026-08-20T05:57:13.867Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1b7a93f4e24790ae8dc01dc5618bba83","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:13.898Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-222e1bcd455629a45f780cd0: done: 0.098795 sec","job_status":"done","queue_duration_s":0.438728,"scheduling_latency_s":0.438774,"redis_calls":12,"redis_duration_s":0.005105999999999999,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00081,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002351,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001945,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042584,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00140524,"exclusive_lock_hold_duration_s":0.01609418,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.098795,"completed_at":"2026-08-20T05:57:14.435Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011485,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1231gitlab # [ 247.690900] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:14.444Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"c6dbff2eedab30334048c907","created_at":"2026-08-20T05:57:13.953Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a366713ead90d67ce6618ee611d3a161","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:13.976Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-c6dbff2eedab30334048c907: start","job_status":"start","queue_duration_s":0.467587,"scheduling_latency_s":0.467671}1232gitlab # [ 248.676351] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:15.466Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"c6dbff2eedab30334048c907","created_at":"2026-08-20T05:57:13.953Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a366713ead90d67ce6618ee611d3a161","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:13.976Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-c6dbff2eedab30334048c907: done: 1.022936 sec","job_status":"done","queue_duration_s":0.467587,"scheduling_latency_s":0.467671,"redis_calls":565,"redis_duration_s":0.53858,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001077,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.008373,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.52913,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.545176,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003854,"duration_s":1.022936,"completed_at":"2026-08-20T05:57:15.466Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00387,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1233gitlab # [ 248.748654] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:15.468Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"6b37bb96099a0e66191cb1b1","created_at":"2026-08-20T05:57:14.059Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b72781d76a3721a9cbbe3fca57dbdf0b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:14.079Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-6b37bb96099a0e66191cb1b1: start","job_status":"start","queue_duration_s":1.389753,"scheduling_latency_s":1.389783}1234gitlab # [ 249.086909] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:15.878Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"6b37bb96099a0e66191cb1b1","created_at":"2026-08-20T05:57:14.059Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b72781d76a3721a9cbbe3fca57dbdf0b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:14.079Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-6b37bb96099a0e66191cb1b1: done: 0.409867 sec","job_status":"done","queue_duration_s":1.389753,"scheduling_latency_s":1.389783,"redis_calls":14,"redis_duration_s":0.005201,"redis_read_bytes":13,"redis_write_bytes":1641,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002075,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":576,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001546,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00158,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.121,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.062,"db_ci_duration_s":0.059,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.269387,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00117244,"exclusive_lock_hold_duration_s":0.315,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.409867,"completed_at":"2026-08-20T05:57:15.878Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.148396,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1235gitlab # [ 249.204145] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:15.880Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"9bb61176ecba6bf21bd1041d","created_at":"2026-08-20T05:57:14.096Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7c826873502d57abd2ffe336d63c62d0","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:14.133Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-9bb61176ecba6bf21bd1041d: start","job_status":"start","queue_duration_s":1.747379,"scheduling_latency_s":1.7474}1236gitlab # [ 249.222339] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.013Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"9bb61176ecba6bf21bd1041d","created_at":"2026-08-20T05:57:14.096Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7c826873502d57abd2ffe336d63c62d0","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:14.133Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-9bb61176ecba6bf21bd1041d: done: 0.132879 sec","job_status":"done","queue_duration_s":1.747379,"scheduling_latency_s":1.7474,"redis_calls":10,"redis_duration_s":0.0037289999999999997,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000811,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002221,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000697,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.082,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.082,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031402,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00074072,"duration_s":0.132879,"completed_at":"2026-08-20T05:57:16.013Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.087274,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1237gitlab # [ 249.275297] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.017Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"934421b3b77712e3801f6e0d","created_at":"2026-08-20T05:57:14.147Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a45edbd8e6a2ef8cc038814150802ff3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:14.183Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-934421b3b77712e3801f6e0d: start","job_status":"start","queue_duration_s":1.834047,"scheduling_latency_s":1.8341}1238gitlab # [ 249.362260] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.153Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"934421b3b77712e3801f6e0d","created_at":"2026-08-20T05:57:14.147Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a45edbd8e6a2ef8cc038814150802ff3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:14.183Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-934421b3b77712e3801f6e0d: done: 0.135933 sec","job_status":"done","queue_duration_s":1.834047,"scheduling_latency_s":1.8341,"redis_calls":12,"redis_duration_s":0.006052999999999999,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000892,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002557,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002604,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.041,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.041,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.070509,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00199714,"exclusive_lock_hold_duration_s":0.04898922,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.135933,"completed_at":"2026-08-20T05:57:16.153Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.045055,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1239gitlab # [ 249.435574] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.157Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"b9363c8b17d4417c496d8ccc","created_at":"2026-08-20T05:57:14.205Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f68d3d68bfa8bd75c5750c3df0c712ff","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:14.230Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-b9363c8b17d4417c496d8ccc: start","job_status":"start","queue_duration_s":1.927007,"scheduling_latency_s":1.92706}1240gitlab # [ 249.451678] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.239Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"b9363c8b17d4417c496d8ccc","created_at":"2026-08-20T05:57:14.205Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f68d3d68bfa8bd75c5750c3df0c712ff","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:14.230Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-b9363c8b17d4417c496d8ccc: done: 0.082474 sec","job_status":"done","queue_duration_s":1.927007,"scheduling_latency_s":1.92706,"redis_calls":12,"redis_duration_s":0.003725,"redis_read_bytes":11,"redis_write_bytes":1612,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000551,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":347,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001794,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00138,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":7,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.017,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047921,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000861,"exclusive_lock_hold_duration_s":0.0402548,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.082474,"completed_at":"2026-08-20T05:57:16.239Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019411,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1241gitlab # [ 249.498035] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.242Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"a649df4f2dccaeae063ccd94","created_at":"2026-08-20T05:57:14.259Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9cf9afcc23c38bc554aac5cc81a8a5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:14.327Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-a649df4f2dccaeae063ccd94: start","job_status":"start","queue_duration_s":1.915664,"scheduling_latency_s":1.915702}1242gitlab # [ 249.512876] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.262Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1243gitlab # [ 249.516224] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.273Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"a649df4f2dccaeae063ccd94","created_at":"2026-08-20T05:57:14.259Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9cf9afcc23c38bc554aac5cc81a8a5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:14.327Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-a649df4f2dccaeae063ccd94: done: 0.0309 sec","job_status":"done","queue_duration_s":1.915664,"scheduling_latency_s":1.915702,"redis_calls":10,"redis_duration_s":0.0022830000000000003,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000519,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001296,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000468,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018391,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034232,"duration_s":0.0309,"completed_at":"2026-08-20T05:57:16.273Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000744,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1244gitlab # [ 249.558500] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.275Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"6b7f9d0767873d07d82eda8a","created_at":"2026-08-20T05:57:14.354Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5a2723db00dd523a5469086104e90fcf","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:14.411Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-6b7f9d0767873d07d82eda8a: start","job_status":"start","queue_duration_s":1.864302,"scheduling_latency_s":1.864328}1245gitlab # [ 249.572542] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.334Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"6b7f9d0767873d07d82eda8a","created_at":"2026-08-20T05:57:14.354Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5a2723db00dd523a5469086104e90fcf","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:14.411Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-6b7f9d0767873d07d82eda8a: done: 0.059475 sec","job_status":"done","queue_duration_s":1.864302,"scheduling_latency_s":1.864328,"redis_calls":10,"redis_duration_s":0.003025,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000357,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001933,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000735,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031098,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0009947,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.059475,"completed_at":"2026-08-20T05:57:16.334Z","load_balancing_strategy":"primary","db_duration_s":0.015675,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1246gitlab # [ 249.615186] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.339Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"e743d5d3b7b6109506326de2","created_at":"2026-08-20T05:57:14.446Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6e8a4862ccc78e19951b9adf7deffd02","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:14.480Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-e743d5d3b7b6109506326de2: start","job_status":"start","queue_duration_s":1.859037,"scheduling_latency_s":1.859085}1247gitlab # [ 249.630045] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.387Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"e743d5d3b7b6109506326de2","created_at":"2026-08-20T05:57:14.446Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6e8a4862ccc78e19951b9adf7deffd02","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:14.480Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-e743d5d3b7b6109506326de2: done: 0.048263 sec","job_status":"done","queue_duration_s":1.859037,"scheduling_latency_s":1.859085,"redis_calls":10,"redis_duration_s":0.0039889999999999995,"redis_read_bytes":9,"redis_write_bytes":1299,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000882,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002289,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000818,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029293,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00065242,"duration_s":0.048263,"completed_at":"2026-08-20T05:57:16.387Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001085,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1248gitlab # [ 249.672561] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.390Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"913bae45469ceb17e6207bd0","created_at":"2026-08-20T05:57:14.525Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6c28a11e671ff7177935edbbfb4cdb06","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:14.552Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-913bae45469ceb17e6207bd0: start","job_status":"start","queue_duration_s":1.838213,"scheduling_latency_s":1.838249}1249gitlab # [ 249.687485] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.413Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1250gitlab # [ 249.691514] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.428Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"913bae45469ceb17e6207bd0","created_at":"2026-08-20T05:57:14.525Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6c28a11e671ff7177935edbbfb4cdb06","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:14.552Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-913bae45469ceb17e6207bd0: done: 0.037809 sec","job_status":"done","queue_duration_s":1.838213,"scheduling_latency_s":1.838249,"redis_calls":10,"redis_duration_s":0.003479,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000709,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002029,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000741,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022208,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00055084,"duration_s":0.037809,"completed_at":"2026-08-20T05:57:16.428Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00108,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1251gitlab # [ 249.735218] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.430Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"f9639068bee95fbe84f9d525","created_at":"2026-08-20T05:57:14.576Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f779cfc95ef74b81d1acc682e000a2c3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T05:57:14.601Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-f9639068bee95fbe84f9d525: start","job_status":"start","queue_duration_s":1.829692,"scheduling_latency_s":1.829726}1252gitlab # [ 249.748875] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.450Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1253gitlab # [ 249.752339] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.461Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"f9639068bee95fbe84f9d525","created_at":"2026-08-20T05:57:14.576Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f779cfc95ef74b81d1acc682e000a2c3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T05:57:14.601Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-f9639068bee95fbe84f9d525: done: 0.031252 sec","job_status":"done","queue_duration_s":1.829692,"scheduling_latency_s":1.829726,"redis_calls":10,"redis_duration_s":0.002967,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000611,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001753,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000603,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017879,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00043018,"duration_s":0.031252,"completed_at":"2026-08-20T05:57:16.461Z","load_balancing_strategy":"primary","db_duration_s":0.000882,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1254gitlab # [ 249.793711] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.464Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"f0aacc1bd78475020caee809","created_at":"2026-08-20T05:57:14.692Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f9d57c4ba029dfbd3bb7068eb15b56b1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:14.712Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-f0aacc1bd78475020caee809: start","job_status":"start","queue_duration_s":1.751192,"scheduling_latency_s":1.751219}1255gitlab # [ 249.808220] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.481Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1256gitlab # [ 249.811303] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.492Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"f0aacc1bd78475020caee809","created_at":"2026-08-20T05:57:14.692Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f9d57c4ba029dfbd3bb7068eb15b56b1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:14.712Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-f0aacc1bd78475020caee809: done: 0.028146 sec","job_status":"done","queue_duration_s":1.751192,"scheduling_latency_s":1.751219,"redis_calls":10,"redis_duration_s":0.002981,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000692,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001648,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000641,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015704,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00040076,"duration_s":0.028146,"completed_at":"2026-08-20T05:57:16.492Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000912,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1257gitlab # [ 249.854073] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.494Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"da3536c9e246fa20b9511c61","created_at":"2026-08-20T05:57:14.752Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ccdcb5a7b25791973a09bf9156250b5b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:14.773Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-da3536c9e246fa20b9511c61: start","job_status":"start","queue_duration_s":1.721272,"scheduling_latency_s":1.721299}1258gitlab # [ 249.867790] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.534Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"da3536c9e246fa20b9511c61","created_at":"2026-08-20T05:57:14.752Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ccdcb5a7b25791973a09bf9156250b5b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:14.773Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-da3536c9e246fa20b9511c61: done: 0.03968 sec","job_status":"done","queue_duration_s":1.721272,"scheduling_latency_s":1.721299,"redis_calls":12,"redis_duration_s":0.003754,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000649,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001664,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001441,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02291,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00070156,"exclusive_lock_hold_duration_s":0.012593759999999999,"duration_s":0.03968,"completed_at":"2026-08-20T05:57:16.534Z","load_balancing_strategy":"primary","db_duration_s":0.006248,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1259gitlab # [ 249.910829] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.536Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"921380bf208a5158f5c8a5ac","created_at":"2026-08-20T05:57:14.808Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"facca3baa0ec889bc2ead9c2cd66da4b","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:14.828Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-921380bf208a5158f5c8a5ac: start","job_status":"start","queue_duration_s":1.707039,"scheduling_latency_s":1.707062}1260gitlab # [ 249.925200] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.584Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"921380bf208a5158f5c8a5ac","created_at":"2026-08-20T05:57:14.808Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"facca3baa0ec889bc2ead9c2cd66da4b","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:14.828Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-921380bf208a5158f5c8a5ac: done: 0.048147 sec","job_status":"done","queue_duration_s":1.707039,"scheduling_latency_s":1.707062,"redis_calls":16,"redis_duration_s":0.004888,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.00267,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001619,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000599,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027645,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00038678,"duration_s":0.048147,"completed_at":"2026-08-20T05:57:16.584Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010269,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1261gitlab # [ 249.967080] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.586Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"a2b87be82a982dd0b6a77a50","created_at":"2026-08-20T05:57:14.878Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:14.900Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-a2b87be82a982dd0b6a77a50: start","job_status":"start","queue_duration_s":1.685282,"scheduling_latency_s":1.685305}1262gitlab # [ 249.980839] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.711Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"a2b87be82a982dd0b6a77a50","created_at":"2026-08-20T05:57:14.878Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:14.900Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-a2b87be82a982dd0b6a77a50: done: 0.125171 sec","job_status":"done","queue_duration_s":1.685282,"scheduling_latency_s":1.685305,"redis_calls":71,"redis_duration_s":0.019993,"redis_read_bytes":120,"redis_write_bytes":42624,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002973,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001455,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.014603,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000962,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.102397,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00040688,"duration_s":0.125171,"completed_at":"2026-08-20T05:57:16.711Z","load_balancing_strategy":"primary","db_duration_s":0.003866,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1263gitlab # [ 250.024119] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.713Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"49d307cb5a8cc981a8c2b03c","created_at":"2026-08-20T05:57:14.960Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6b2eaa39dfa9da8b9f79c40b02eb3da8","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:14.987Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-49d307cb5a8cc981a8c2b03c: start","job_status":"start","queue_duration_s":1.725862,"scheduling_latency_s":1.725887}1264gitlab # [ 250.038575] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.754Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"49d307cb5a8cc981a8c2b03c","created_at":"2026-08-20T05:57:14.960Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6b2eaa39dfa9da8b9f79c40b02eb3da8","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:14.987Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-49d307cb5a8cc981a8c2b03c: done: 0.040764 sec","job_status":"done","queue_duration_s":1.725862,"scheduling_latency_s":1.725887,"redis_calls":13,"redis_duration_s":0.003943,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000634,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001976,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001333,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025312,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01326874,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.040764,"completed_at":"2026-08-20T05:57:16.754Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005612,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1265gitlab # [ 250.082587] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.755Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"908236c11f98926cb54e7079","created_at":"2026-08-20T05:57:15.013Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6491cb3388d85b1b3d4a075af1d2dff9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:15.038Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-908236c11f98926cb54e7079: start","job_status":"start","queue_duration_s":1.717262,"scheduling_latency_s":1.717285}1266gitlab # [ 250.097660] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.771Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1267gitlab # [ 250.101447] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.779Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"908236c11f98926cb54e7079","created_at":"2026-08-20T05:57:15.013Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6491cb3388d85b1b3d4a075af1d2dff9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:15.038Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-908236c11f98926cb54e7079: done: 0.02369 sec","job_status":"done","queue_duration_s":1.717262,"scheduling_latency_s":1.717285,"redis_calls":10,"redis_duration_s":0.0027010000000000003,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000625,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001539,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000537,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012996,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00035338,"duration_s":0.02369,"completed_at":"2026-08-20T05:57:16.779Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000824,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1268gitlab # [ 250.146082] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.781Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"d88974386a1a6a1cb2fca74d","created_at":"2026-08-20T05:57:15.072Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5b79105d7643efad780b8051e421251d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:15.120Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-d88974386a1a6a1cb2fca74d: start","job_status":"start","queue_duration_s":1.661143,"scheduling_latency_s":1.661166}1269gitlab # [ 250.160121] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.822Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"d88974386a1a6a1cb2fca74d","created_at":"2026-08-20T05:57:15.072Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5b79105d7643efad780b8051e421251d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:15.120Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-d88974386a1a6a1cb2fca74d: done: 0.041409 sec","job_status":"done","queue_duration_s":1.661143,"scheduling_latency_s":1.661166,"redis_calls":19,"redis_duration_s":0.004942,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001146,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000392,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002593,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000811,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027962,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003309,"duration_s":0.041409,"completed_at":"2026-08-20T05:57:16.822Z","load_balancing_strategy":"primary","db_duration_s":0.003883,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1270gitlab # [ 250.203537] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.824Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6fd76f7e5ab23e06fe4df49b","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6fd76f7e5ab23e06fe4df49b: start","job_status":"start","queue_duration_s":0.124366,"scheduling_latency_s":0.124385}1271gitlab # [ 250.216505] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.850Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6fd76f7e5ab23e06fe4df49b","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6fd76f7e5ab23e06fe4df49b: done: 0.02566 sec","job_status":"done","queue_duration_s":0.124366,"scheduling_latency_s":0.124385,"redis_calls":16,"redis_duration_s":0.004758,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000604,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001163,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002991,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014993,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037838,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02566,"completed_at":"2026-08-20T05:57:16.850Z","load_balancing_strategy":"primary","db_duration_s":0.000795,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1272gitlab # [ 250.258091] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.851Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de7dc64006df30366ca9f580","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de7dc64006df30366ca9f580: start","job_status":"start","queue_duration_s":0.151598,"scheduling_latency_s":0.151616}1273gitlab # [ 250.270719] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.869Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de7dc64006df30366ca9f580","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de7dc64006df30366ca9f580: done: 0.017483 sec","job_status":"done","queue_duration_s":0.151598,"scheduling_latency_s":0.151616,"redis_calls":13,"redis_duration_s":0.002925,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001012,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001913,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010742,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017483,"completed_at":"2026-08-20T05:57:16.869Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1274gitlab # [ 250.310142] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.870Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dffb6eb5c796037aa4d7b346","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dffb6eb5c796037aa4d7b346: start","job_status":"start","queue_duration_s":0.170773,"scheduling_latency_s":0.170791}1275gitlab # [ 250.323907] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.886Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dffb6eb5c796037aa4d7b346","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dffb6eb5c796037aa4d7b346: done: 0.015777 sec","job_status":"done","queue_duration_s":0.170773,"scheduling_latency_s":0.170791,"redis_calls":13,"redis_duration_s":0.0025900000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00093,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00166,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009832,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015777,"completed_at":"2026-08-20T05:57:16.886Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1276gitlab # [ 250.363946] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.888Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"efc56abfb483e9f44b5d9ca4","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-efc56abfb483e9f44b5d9ca4: start","job_status":"start","queue_duration_s":0.18808,"scheduling_latency_s":0.188098}1277gitlab # [ 250.376783] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.911Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"efc56abfb483e9f44b5d9ca4","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-efc56abfb483e9f44b5d9ca4: done: 0.023329 sec","job_status":"done","queue_duration_s":0.18808,"scheduling_latency_s":0.188098,"redis_calls":13,"redis_duration_s":0.003881,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001136,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002745,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017637,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023329,"completed_at":"2026-08-20T05:57:16.911Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1278gitlab # [ 250.424247] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.913Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9e001cad01b3c5e64049188b","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9e001cad01b3c5e64049188b: start","job_status":"start","queue_duration_s":0.213454,"scheduling_latency_s":0.213473}1279gitlab # [ 250.437962] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.930Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9e001cad01b3c5e64049188b","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9e001cad01b3c5e64049188b: done: 0.01691 sec","job_status":"done","queue_duration_s":0.213454,"scheduling_latency_s":0.213473,"redis_calls":13,"redis_duration_s":0.003047,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000973,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002074,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010511,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01691,"completed_at":"2026-08-20T05:57:16.930Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1280gitlab # [ 250.477083] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.932Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"49e92d726d53c45dfc76724e","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-49e92d726d53c45dfc76724e: start","job_status":"start","queue_duration_s":0.232001,"scheduling_latency_s":0.23202}1281gitlab # [ 250.489475] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.949Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"49e92d726d53c45dfc76724e","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-49e92d726d53c45dfc76724e: done: 0.017552 sec","job_status":"done","queue_duration_s":0.232001,"scheduling_latency_s":0.23202,"redis_calls":13,"redis_duration_s":0.00298,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001067,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001913,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011504,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017552,"completed_at":"2026-08-20T05:57:16.949Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1282gitlab # [ 250.529458] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.951Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ae9703c13c0746d50a5fd08","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ae9703c13c0746d50a5fd08: start","job_status":"start","queue_duration_s":0.251302,"scheduling_latency_s":0.251319}1283gitlab # [ 250.541656] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.967Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ae9703c13c0746d50a5fd08","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ae9703c13c0746d50a5fd08: done: 0.015675 sec","job_status":"done","queue_duration_s":0.251302,"scheduling_latency_s":0.251319,"redis_calls":13,"redis_duration_s":0.002723,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000932,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001791,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009948,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015675,"completed_at":"2026-08-20T05:57:16.966Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1284gitlab # [ 250.580516] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.968Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb20887b18d5c9394d033758","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb20887b18d5c9394d033758: start","job_status":"start","queue_duration_s":0.26842,"scheduling_latency_s":0.268437}1285gitlab # [ 250.592829] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.984Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb20887b18d5c9394d033758","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb20887b18d5c9394d033758: done: 0.015797 sec","job_status":"done","queue_duration_s":0.26842,"scheduling_latency_s":0.268437,"redis_calls":13,"redis_duration_s":0.002796,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000905,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001891,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009917,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015797,"completed_at":"2026-08-20T05:57:16.984Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1286gitlab # [ 250.631699] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:16.985Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf23da816b093eefd8145d78","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf23da816b093eefd8145d78: start","job_status":"start","queue_duration_s":0.285709,"scheduling_latency_s":0.285727}1287gitlab # [ 250.644273] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.001Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf23da816b093eefd8145d78","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf23da816b093eefd8145d78: done: 0.015786 sec","job_status":"done","queue_duration_s":0.285709,"scheduling_latency_s":0.285727,"redis_calls":13,"redis_duration_s":0.0027860000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000913,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001873,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009963,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015786,"completed_at":"2026-08-20T05:57:17.001Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1288gitlab # [ 250.683294] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.002Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b67fe860875d57383a189ab","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b67fe860875d57383a189ab: start","job_status":"start","queue_duration_s":0.302902,"scheduling_latency_s":0.302918}1289gitlab # [ 250.696166] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.019Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b67fe860875d57383a189ab","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b67fe860875d57383a189ab: done: 0.016267 sec","job_status":"done","queue_duration_s":0.302902,"scheduling_latency_s":0.302918,"redis_calls":13,"redis_duration_s":0.002977,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000974,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002003,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010174,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016267,"completed_at":"2026-08-20T05:57:17.019Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1290gitlab # [ 250.735727] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.020Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2e30e89406543d47de5b210c","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2e30e89406543d47de5b210c: start","job_status":"start","queue_duration_s":0.320547,"scheduling_latency_s":0.320567}1291gitlab # [ 250.748321] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.036Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2e30e89406543d47de5b210c","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2e30e89406543d47de5b210c: done: 0.015809 sec","job_status":"done","queue_duration_s":0.320547,"scheduling_latency_s":0.320567,"redis_calls":13,"redis_duration_s":0.002619,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000972,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001647,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009988,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015809,"completed_at":"2026-08-20T05:57:17.036Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1292gitlab # [ 250.787165] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.037Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d7cf1ab538cb03adc517116b","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d7cf1ab538cb03adc517116b: start","job_status":"start","queue_duration_s":0.337631,"scheduling_latency_s":0.337646}1293gitlab # [ 250.799658] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.053Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d7cf1ab538cb03adc517116b","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d7cf1ab538cb03adc517116b: done: 0.015913 sec","job_status":"done","queue_duration_s":0.337631,"scheduling_latency_s":0.337646,"redis_calls":13,"redis_duration_s":0.002839,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000956,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001883,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009801,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015913,"completed_at":"2026-08-20T05:57:17.053Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1294gitlab # [ 250.838724] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.055Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d6f352619cc026240c13ed3","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d6f352619cc026240c13ed3: start","job_status":"start","queue_duration_s":0.355069,"scheduling_latency_s":0.355088}1295gitlab # [ 250.850867] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.070Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d6f352619cc026240c13ed3","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d6f352619cc026240c13ed3: done: 0.015206 sec","job_status":"done","queue_duration_s":0.355069,"scheduling_latency_s":0.355088,"redis_calls":13,"redis_duration_s":0.002657,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000921,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001736,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009573,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015206,"completed_at":"2026-08-20T05:57:17.070Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1296gitlab # [ 250.889928] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.071Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27bd1c972369731fefdef451","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27bd1c972369731fefdef451: start","job_status":"start","queue_duration_s":0.371728,"scheduling_latency_s":0.371745}1297gitlab # [ 250.902250] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.088Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27bd1c972369731fefdef451","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27bd1c972369731fefdef451: done: 0.016742 sec","job_status":"done","queue_duration_s":0.371728,"scheduling_latency_s":0.371745,"redis_calls":13,"redis_duration_s":0.0039829999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001635,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002348,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010021,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016742,"completed_at":"2026-08-20T05:57:17.088Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1298gitlab # [ 250.942173] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.090Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"92e24764e9c06dd4fe8f2c06","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-92e24764e9c06dd4fe8f2c06: start","job_status":"start","queue_duration_s":0.390205,"scheduling_latency_s":0.390222}1299gitlab # [ 250.954324] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.106Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"92e24764e9c06dd4fe8f2c06","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-92e24764e9c06dd4fe8f2c06: done: 0.016054 sec","job_status":"done","queue_duration_s":0.390205,"scheduling_latency_s":0.390222,"redis_calls":13,"redis_duration_s":0.003385,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001129,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002256,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009863,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016054,"completed_at":"2026-08-20T05:57:17.106Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1300gitlab # [ 250.993228] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.107Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac7f77a81efa5becb0cb8153","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac7f77a81efa5becb0cb8153: start","job_status":"start","queue_duration_s":0.407868,"scheduling_latency_s":0.407886}1301gitlab # [ 251.005521] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.123Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac7f77a81efa5becb0cb8153","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac7f77a81efa5becb0cb8153: done: 0.015605 sec","job_status":"done","queue_duration_s":0.407868,"scheduling_latency_s":0.407886,"redis_calls":13,"redis_duration_s":0.002927,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000938,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001989,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010031,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015605,"completed_at":"2026-08-20T05:57:17.123Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1302gitlab # [ 251.044296] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.126Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c60843578a210a627bf96506","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c60843578a210a627bf96506: start","job_status":"start","queue_duration_s":0.426112,"scheduling_latency_s":0.426162}1303gitlab # [ 251.056508] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.164Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c60843578a210a627bf96506","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c60843578a210a627bf96506: done: 0.038306 sec","job_status":"done","queue_duration_s":0.426112,"scheduling_latency_s":0.426162,"redis_calls":13,"redis_duration_s":0.003425,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001266,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002159,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027546,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.038306,"completed_at":"2026-08-20T05:57:17.164Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1304gitlab # [ 251.095783] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.167Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c663453120c949e3f04b9e3","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c663453120c949e3f04b9e3: start","job_status":"start","queue_duration_s":0.467567,"scheduling_latency_s":0.46765}1305gitlab # [ 251.108214] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.201Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c663453120c949e3f04b9e3","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c663453120c949e3f04b9e3: done: 0.033766 sec","job_status":"done","queue_duration_s":0.467567,"scheduling_latency_s":0.46765,"redis_calls":13,"redis_duration_s":0.002663,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000941,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001722,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018932,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033766,"completed_at":"2026-08-20T05:57:17.201Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1306gitlab # [ 251.148131] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.203Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6a55c8bd065639da7da70480","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6a55c8bd065639da7da70480: start","job_status":"start","queue_duration_s":0.503657,"scheduling_latency_s":0.503683}1307gitlab # [ 251.160498] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.223Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6a55c8bd065639da7da70480","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6a55c8bd065639da7da70480: done: 0.019654 sec","job_status":"done","queue_duration_s":0.503657,"scheduling_latency_s":0.503683,"redis_calls":13,"redis_duration_s":0.002035,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000733,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001302,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013761,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019654,"completed_at":"2026-08-20T05:57:17.223Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1308gitlab # [ 251.199557] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.225Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"965318252e0b72d14e620e25","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-965318252e0b72d14e620e25: start","job_status":"start","queue_duration_s":0.525079,"scheduling_latency_s":0.5251}1309gitlab # [ 251.212036] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.242Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"965318252e0b72d14e620e25","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-965318252e0b72d14e620e25: done: 0.017541 sec","job_status":"done","queue_duration_s":0.525079,"scheduling_latency_s":0.5251,"redis_calls":13,"redis_duration_s":0.00184,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000676,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001164,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012355,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017541,"completed_at":"2026-08-20T05:57:17.242Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1310gitlab # [ 251.250452] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.244Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"29497341822b9823015491da","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-29497341822b9823015491da: start","job_status":"start","queue_duration_s":0.544246,"scheduling_latency_s":0.544267}1311gitlab # [ 251.262948] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.261Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"29497341822b9823015491da","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-29497341822b9823015491da: done: 0.017048 sec","job_status":"done","queue_duration_s":0.544246,"scheduling_latency_s":0.544267,"redis_calls":13,"redis_duration_s":0.001764,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000666,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001098,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011712,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017048,"completed_at":"2026-08-20T05:57:17.261Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1312gitlab # [ 251.302167] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.262Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3e96ad1259111522a232a67","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3e96ad1259111522a232a67: start","job_status":"start","queue_duration_s":0.562655,"scheduling_latency_s":0.562676}1313gitlab # [ 251.314776] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.279Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3e96ad1259111522a232a67","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3e96ad1259111522a232a67: done: 0.016653 sec","job_status":"done","queue_duration_s":0.562655,"scheduling_latency_s":0.562676,"redis_calls":13,"redis_duration_s":0.0018,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000647,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001153,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011546,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016653,"completed_at":"2026-08-20T05:57:17.279Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1314gitlab # [ 251.355623] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.280Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf3c5409f30a9c57bf4659b6","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf3c5409f30a9c57bf4659b6: start","job_status":"start","queue_duration_s":0.580585,"scheduling_latency_s":0.580606}1315gitlab # [ 251.368191] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.295Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf3c5409f30a9c57bf4659b6","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf3c5409f30a9c57bf4659b6: done: 0.01507 sec","job_status":"done","queue_duration_s":0.580585,"scheduling_latency_s":0.580606,"redis_calls":13,"redis_duration_s":0.0017269999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001187,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010402,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01507,"completed_at":"2026-08-20T05:57:17.295Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1316gitlab # [ 251.408238] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.297Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"361054754e5e4ca46da3de01","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-361054754e5e4ca46da3de01: start","job_status":"start","queue_duration_s":0.59694,"scheduling_latency_s":0.59696}1317gitlab # [ 251.420700] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.312Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"361054754e5e4ca46da3de01","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-361054754e5e4ca46da3de01: done: 0.015723 sec","job_status":"done","queue_duration_s":0.59694,"scheduling_latency_s":0.59696,"redis_calls":13,"redis_duration_s":0.001596,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000619,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000977,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010424,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015723,"completed_at":"2026-08-20T05:57:17.312Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1318gitlab # [ 251.459974] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.314Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"102f55ea88c318de65aae5fb","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-102f55ea88c318de65aae5fb: start","job_status":"start","queue_duration_s":0.614028,"scheduling_latency_s":0.614048}1319gitlab # [ 251.472678] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.329Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"102f55ea88c318de65aae5fb","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-102f55ea88c318de65aae5fb: done: 0.015434 sec","job_status":"done","queue_duration_s":0.614028,"scheduling_latency_s":0.614048,"redis_calls":13,"redis_duration_s":0.00168,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000593,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001087,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010368,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015434,"completed_at":"2026-08-20T05:57:17.329Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1320gitlab # [ 251.512148] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.330Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"341a471116b5ae5f7ede1995","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-341a471116b5ae5f7ede1995: start","job_status":"start","queue_duration_s":0.630773,"scheduling_latency_s":0.630794}1321gitlab # [ 251.524259] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.346Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"341a471116b5ae5f7ede1995","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-341a471116b5ae5f7ede1995: done: 0.015207 sec","job_status":"done","queue_duration_s":0.630773,"scheduling_latency_s":0.630794,"redis_calls":13,"redis_duration_s":0.001652,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000593,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001059,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010438,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015207,"completed_at":"2026-08-20T05:57:17.345Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1322gitlab # [ 251.564746] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.347Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b9d1767df98eedcb1842568","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b9d1767df98eedcb1842568: start","job_status":"start","queue_duration_s":0.647469,"scheduling_latency_s":0.647488}1323gitlab # [ 251.577093] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.491Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b9d1767df98eedcb1842568","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b9d1767df98eedcb1842568: done: 0.143521 sec","job_status":"done","queue_duration_s":0.647469,"scheduling_latency_s":0.647488,"redis_calls":13,"redis_duration_s":0.002007,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000775,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001232,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.136501,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.143521,"completed_at":"2026-08-20T05:57:17.490Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1324gitlab # [ 251.616318] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.492Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b1fd2eb3d20a1fd2e57e3679","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b1fd2eb3d20a1fd2e57e3679: start","job_status":"start","queue_duration_s":0.792484,"scheduling_latency_s":0.79251}1325gitlab # [ 251.628685] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.509Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b1fd2eb3d20a1fd2e57e3679","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b1fd2eb3d20a1fd2e57e3679: done: 0.017033 sec","job_status":"done","queue_duration_s":0.792484,"scheduling_latency_s":0.79251,"redis_calls":13,"redis_duration_s":0.0018510000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00063,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001221,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011494,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017033,"completed_at":"2026-08-20T05:57:17.509Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1326gitlab # [ 251.667901] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.510Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"498edfeaffead3281e91311e","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-498edfeaffead3281e91311e: start","job_status":"start","queue_duration_s":0.810839,"scheduling_latency_s":0.81086}1327gitlab # [ 251.680602] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.526Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"498edfeaffead3281e91311e","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-498edfeaffead3281e91311e: done: 0.016092 sec","job_status":"done","queue_duration_s":0.810839,"scheduling_latency_s":0.81086,"redis_calls":13,"redis_duration_s":0.0016840000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000623,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001061,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011136,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016092,"completed_at":"2026-08-20T05:57:17.526Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1328gitlab # [ 251.720553] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.528Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91e733fdd599ca6f323b95a1","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91e733fdd599ca6f323b95a1: start","job_status":"start","queue_duration_s":0.82836,"scheduling_latency_s":0.828382}1329gitlab # [ 251.733247] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.544Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91e733fdd599ca6f323b95a1","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91e733fdd599ca6f323b95a1: done: 0.015855 sec","job_status":"done","queue_duration_s":0.82836,"scheduling_latency_s":0.828382,"redis_calls":13,"redis_duration_s":0.001766,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000603,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001163,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010962,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015855,"completed_at":"2026-08-20T05:57:17.544Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1330gitlab # [ 251.773774] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.545Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c76d1883e3984b4fa167fa6","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c76d1883e3984b4fa167fa6: start","job_status":"start","queue_duration_s":0.845517,"scheduling_latency_s":0.845537}1331gitlab # [ 251.786211] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.560Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c76d1883e3984b4fa167fa6","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c76d1883e3984b4fa167fa6: done: 0.015105 sec","job_status":"done","queue_duration_s":0.845517,"scheduling_latency_s":0.845537,"redis_calls":13,"redis_duration_s":0.0015539999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000609,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000945,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010478,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015105,"completed_at":"2026-08-20T05:57:17.560Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1332gitlab # [ 251.825205] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.561Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f67eb8bee8d28bca8cd27ffe","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f67eb8bee8d28bca8cd27ffe: start","job_status":"start","queue_duration_s":0.861747,"scheduling_latency_s":0.861766}1333gitlab # [ 251.837922] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.576Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f67eb8bee8d28bca8cd27ffe","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f67eb8bee8d28bca8cd27ffe: done: 0.015054 sec","job_status":"done","queue_duration_s":0.861747,"scheduling_latency_s":0.861766,"redis_calls":13,"redis_duration_s":0.0015040000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000958,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009649,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015054,"completed_at":"2026-08-20T05:57:17.576Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1334gitlab # [ 251.877730] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.579Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de2f5e768aa2d00c01cb7195","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de2f5e768aa2d00c01cb7195: start","job_status":"start","queue_duration_s":0.878936,"scheduling_latency_s":0.878955}1335gitlab # [ 251.890277] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.594Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de2f5e768aa2d00c01cb7195","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de2f5e768aa2d00c01cb7195: done: 0.015362 sec","job_status":"done","queue_duration_s":0.878936,"scheduling_latency_s":0.878955,"redis_calls":13,"redis_duration_s":0.001535,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000975,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009741,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015362,"completed_at":"2026-08-20T05:57:17.594Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1336gitlab # [ 251.929565] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.595Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d14caa06cce02f79206daf1","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d14caa06cce02f79206daf1: start","job_status":"start","queue_duration_s":0.895625,"scheduling_latency_s":0.895643}1337gitlab # [ 251.942124] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.611Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d14caa06cce02f79206daf1","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d14caa06cce02f79206daf1: done: 0.015944 sec","job_status":"done","queue_duration_s":0.895625,"scheduling_latency_s":0.895643,"redis_calls":13,"redis_duration_s":0.001699,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000592,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001107,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011024,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015944,"completed_at":"2026-08-20T05:57:17.611Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1338gitlab # [ 251.982440] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.612Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3017153215d7e0524f45b6a7","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3017153215d7e0524f45b6a7: start","job_status":"start","queue_duration_s":0.912845,"scheduling_latency_s":0.912865}1339gitlab # [ 251.995110] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.628Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3017153215d7e0524f45b6a7","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3017153215d7e0524f45b6a7: done: 0.015555 sec","job_status":"done","queue_duration_s":0.912845,"scheduling_latency_s":0.912865,"redis_calls":13,"redis_duration_s":0.0016749999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000591,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001084,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010904,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015555,"completed_at":"2026-08-20T05:57:17.628Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1340gitlab # [ 252.035426] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.629Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2ded236dac0a9887e66dac5","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2ded236dac0a9887e66dac5: start","job_status":"start","queue_duration_s":0.929631,"scheduling_latency_s":0.929649}1341gitlab # [ 252.047952] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.645Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2ded236dac0a9887e66dac5","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2ded236dac0a9887e66dac5: done: 0.015801 sec","job_status":"done","queue_duration_s":0.929631,"scheduling_latency_s":0.929649,"redis_calls":13,"redis_duration_s":0.001705,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000614,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001091,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01109,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015801,"completed_at":"2026-08-20T05:57:17.645Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1342gitlab # [ 252.087782] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.646Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b84c39b461a17e3f169f6c73","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b84c39b461a17e3f169f6c73: start","job_status":"start","queue_duration_s":0.946629,"scheduling_latency_s":0.946648}1343gitlab # [ 252.100530] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.662Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b84c39b461a17e3f169f6c73","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b84c39b461a17e3f169f6c73: done: 0.016024 sec","job_status":"done","queue_duration_s":0.946629,"scheduling_latency_s":0.946648,"redis_calls":13,"redis_duration_s":0.001576,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000578,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000998,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00978,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016024,"completed_at":"2026-08-20T05:57:17.662Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1344gitlab # [ 252.139783] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.663Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0326aaedc17dd31152fc6c8b","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0326aaedc17dd31152fc6c8b: start","job_status":"start","queue_duration_s":0.963836,"scheduling_latency_s":0.963853}1345gitlab # [ 252.153613] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.679Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0326aaedc17dd31152fc6c8b","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0326aaedc17dd31152fc6c8b: done: 0.015376 sec","job_status":"done","queue_duration_s":0.963836,"scheduling_latency_s":0.963853,"redis_calls":13,"redis_duration_s":0.001693,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000612,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001081,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010767,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015376,"completed_at":"2026-08-20T05:57:17.679Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1346gitlab # [ 252.192597] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.680Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"14af692fae9c006e63c778b2","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-14af692fae9c006e63c778b2: start","job_status":"start","queue_duration_s":0.9804,"scheduling_latency_s":0.980417}1347gitlab # [ 252.204953] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.695Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"14af692fae9c006e63c778b2","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-14af692fae9c006e63c778b2: done: 0.015145 sec","job_status":"done","queue_duration_s":0.9804,"scheduling_latency_s":0.980417,"redis_calls":13,"redis_duration_s":0.0015300000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000553,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000977,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010698,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015145,"completed_at":"2026-08-20T05:57:17.695Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1348gitlab # [ 252.244703] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.696Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"752c94a97d6f3dbc55328e6b","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-752c94a97d6f3dbc55328e6b: start","job_status":"start","queue_duration_s":0.996727,"scheduling_latency_s":0.996745}1349gitlab # [ 252.257056] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.712Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"752c94a97d6f3dbc55328e6b","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-752c94a97d6f3dbc55328e6b: done: 0.015377 sec","job_status":"done","queue_duration_s":0.996727,"scheduling_latency_s":0.996745,"redis_calls":13,"redis_duration_s":0.0018479999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000561,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001287,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01069,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015377,"completed_at":"2026-08-20T05:57:17.712Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1350gitlab # [ 252.296408] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.713Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f9c9835a04b89b749d54e323","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f9c9835a04b89b749d54e323: start","job_status":"start","queue_duration_s":1.013306,"scheduling_latency_s":1.013324}1351gitlab # [ 252.308830] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.728Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f9c9835a04b89b749d54e323","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f9c9835a04b89b749d54e323: done: 0.01563 sec","job_status":"done","queue_duration_s":1.013306,"scheduling_latency_s":1.013324,"redis_calls":13,"redis_duration_s":0.001598,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000552,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001046,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009659,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01563,"completed_at":"2026-08-20T05:57:17.728Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1352gitlab # [ 252.348063] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.730Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"186b0e9dcdeec063b116bbcc","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-186b0e9dcdeec063b116bbcc: start","job_status":"start","queue_duration_s":1.030133,"scheduling_latency_s":1.030151}1353gitlab # [ 252.361414] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.745Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"186b0e9dcdeec063b116bbcc","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-186b0e9dcdeec063b116bbcc: done: 0.015471 sec","job_status":"done","queue_duration_s":1.030133,"scheduling_latency_s":1.030151,"redis_calls":13,"redis_duration_s":0.00162,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000616,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001004,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010894,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015471,"completed_at":"2026-08-20T05:57:17.745Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1354gitlab # [ 252.400772] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.746Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"24e5daa24be93a2a87d0f01f","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-24e5daa24be93a2a87d0f01f: start","job_status":"start","queue_duration_s":1.046786,"scheduling_latency_s":1.046803}1355gitlab # [ 252.413210] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.762Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"24e5daa24be93a2a87d0f01f","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-24e5daa24be93a2a87d0f01f: done: 0.015226 sec","job_status":"done","queue_duration_s":1.046786,"scheduling_latency_s":1.046803,"redis_calls":13,"redis_duration_s":0.001608,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000565,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001043,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01068,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015226,"completed_at":"2026-08-20T05:57:17.761Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1356gitlab # [ 252.452531] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.763Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dcf7c5ef0b4268da4cabf750","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dcf7c5ef0b4268da4cabf750: start","job_status":"start","queue_duration_s":1.063191,"scheduling_latency_s":1.06321}1357gitlab # [ 252.465051] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.778Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dcf7c5ef0b4268da4cabf750","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dcf7c5ef0b4268da4cabf750: done: 0.015102 sec","job_status":"done","queue_duration_s":1.063191,"scheduling_latency_s":1.06321,"redis_calls":13,"redis_duration_s":0.0015990000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000569,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00103,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009661,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015102,"completed_at":"2026-08-20T05:57:17.778Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1358gitlab # [ 252.505251] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.780Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d45eea1fa9ff107a5d1fdc4f","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d45eea1fa9ff107a5d1fdc4f: start","job_status":"start","queue_duration_s":1.080635,"scheduling_latency_s":1.080654}1359gitlab # [ 252.517799] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.795Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d45eea1fa9ff107a5d1fdc4f","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d45eea1fa9ff107a5d1fdc4f: done: 0.014817 sec","job_status":"done","queue_duration_s":1.080635,"scheduling_latency_s":1.080654,"redis_calls":13,"redis_duration_s":0.002241,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000556,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001685,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010394,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014817,"completed_at":"2026-08-20T05:57:17.795Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1360gitlab # [ 252.557273] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.796Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04bd735c4b8c8660dac96c52","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04bd735c4b8c8660dac96c52: start","job_status":"start","queue_duration_s":1.096627,"scheduling_latency_s":1.096645}1361gitlab # [ 252.570808] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.812Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04bd735c4b8c8660dac96c52","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04bd735c4b8c8660dac96c52: done: 0.015363 sec","job_status":"done","queue_duration_s":1.096627,"scheduling_latency_s":1.096645,"redis_calls":13,"redis_duration_s":0.00179,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000541,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001249,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010766,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015363,"completed_at":"2026-08-20T05:57:17.811Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1362gitlab # [ 252.610002] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.813Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5cd0da27bff5a5ac14691e52","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5cd0da27bff5a5ac14691e52: start","job_status":"start","queue_duration_s":1.113186,"scheduling_latency_s":1.113205}1363gitlab # [ 252.622639] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.828Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5cd0da27bff5a5ac14691e52","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5cd0da27bff5a5ac14691e52: done: 0.015043 sec","job_status":"done","queue_duration_s":1.113186,"scheduling_latency_s":1.113205,"redis_calls":13,"redis_duration_s":0.00157,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000564,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001006,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010646,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015043,"completed_at":"2026-08-20T05:57:17.828Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1364gitlab # [ 252.662099] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.829Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c0b604cbd7c0610a69521be0","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c0b604cbd7c0610a69521be0: start","job_status":"start","queue_duration_s":1.129404,"scheduling_latency_s":1.129422}1365gitlab # [ 252.674604] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.846Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c0b604cbd7c0610a69521be0","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c0b604cbd7c0610a69521be0: done: 0.017303 sec","job_status":"done","queue_duration_s":1.129404,"scheduling_latency_s":1.129422,"redis_calls":13,"redis_duration_s":0.0015999999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000587,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001013,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009828,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017303,"completed_at":"2026-08-20T05:57:17.846Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1366gitlab # [ 252.714267] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.849Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"29ed6401a64a9917800721e1","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-29ed6401a64a9917800721e1: start","job_status":"start","queue_duration_s":1.14897,"scheduling_latency_s":1.148988}1367gitlab # [ 252.727162] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.865Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"29ed6401a64a9917800721e1","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-29ed6401a64a9917800721e1: done: 0.016504 sec","job_status":"done","queue_duration_s":1.14897,"scheduling_latency_s":1.148988,"redis_calls":13,"redis_duration_s":0.001601,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000605,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000996,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011926,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016504,"completed_at":"2026-08-20T05:57:17.865Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1368gitlab # [ 252.767807] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.866Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9e6a7a1a774576210cf0eda0","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9e6a7a1a774576210cf0eda0: start","job_status":"start","queue_duration_s":1.166679,"scheduling_latency_s":1.166696}1369gitlab # [ 252.780549] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.882Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9e6a7a1a774576210cf0eda0","created_at":"2026-08-20T05:57:16.612Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-d1bfcc0f299e4b75","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bfcf5b2d58db4e8f1fb3e342994dbdd6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.700Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9e6a7a1a774576210cf0eda0: done: 0.016031 sec","job_status":"done","queue_duration_s":1.166679,"scheduling_latency_s":1.166696,"redis_calls":13,"redis_duration_s":0.001503,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000976,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011543,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016031,"completed_at":"2026-08-20T05:57:17.882Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1370gitlab # [ 252.819799] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.883Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1550f4104ad7157687180029","created_at":"2026-08-20T05:57:16.799Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-49c3bc959eb2416e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5b79105d7643efad780b8051e421251d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.814Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1550f4104ad7157687180029: start","job_status":"start","queue_duration_s":1.069394,"scheduling_latency_s":1.069412}1371gitlab # [ 252.832214] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.902Z","message":"No existing merge request to be cleaned up."}1372gitlab # [ 252.833836] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.918Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1550f4104ad7157687180029","created_at":"2026-08-20T05:57:16.799Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-49c3bc959eb2416e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5b79105d7643efad780b8051e421251d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.814Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1550f4104ad7157687180029: done: 0.03473 sec","job_status":"done","queue_duration_s":1.069394,"scheduling_latency_s":1.069412,"redis_calls":13,"redis_duration_s":0.001875,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000356,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000655,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000864,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024166,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026086,"duration_s":0.03473,"completed_at":"2026-08-20T05:57:17.918Z","load_balancing_strategy":"primary","db_duration_s":0.004923,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1373gitlab # [ 252.874005] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.920Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1ac2d6031b29804403f739f6","created_at":"2026-08-20T05:57:16.799Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-49c3bc959eb2416e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5b79105d7643efad780b8051e421251d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.814Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1ac2d6031b29804403f739f6: start","job_status":"start","queue_duration_s":1.106188,"scheduling_latency_s":1.106207}1374gitlab # [ 252.886551] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.932Z","message":"No existing merge request to be cleaned up."}1375gitlab # [ 252.888265] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.942Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1ac2d6031b29804403f739f6","created_at":"2026-08-20T05:57:16.799Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-49c3bc959eb2416e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5b79105d7643efad780b8051e421251d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.814Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1ac2d6031b29804403f739f6: done: 0.021967 sec","job_status":"done","queue_duration_s":1.106188,"scheduling_latency_s":1.106207,"redis_calls":10,"redis_duration_s":0.001474,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000656,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000818,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015227,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021967,"completed_at":"2026-08-20T05:57:17.942Z","load_balancing_strategy":"primary","db_duration_s":0.003326,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1376gitlab # [ 252.927024] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.943Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"422b1b94f73962ae973fc675","created_at":"2026-08-20T05:57:16.799Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-49c3bc959eb2416e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5b79105d7643efad780b8051e421251d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.814Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-422b1b94f73962ae973fc675: start","job_status":"start","queue_duration_s":1.129348,"scheduling_latency_s":1.129367}1377gitlab # [ 252.939655] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.956Z","message":"No existing merge request to be cleaned up."}1378gitlab # [ 252.941394] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.965Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"422b1b94f73962ae973fc675","created_at":"2026-08-20T05:57:16.799Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-49c3bc959eb2416e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5b79105d7643efad780b8051e421251d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.814Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-422b1b94f73962ae973fc675: done: 0.021315 sec","job_status":"done","queue_duration_s":1.129348,"scheduling_latency_s":1.129367,"redis_calls":10,"redis_duration_s":0.0015249999999999999,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000654,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000871,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014923,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021315,"completed_at":"2026-08-20T05:57:17.965Z","load_balancing_strategy":"primary","db_duration_s":0.002845,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1379gitlab # [ 252.981356] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.966Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"810239cb28f5303eb18b9619","created_at":"2026-08-20T05:57:16.799Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-49c3bc959eb2416e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5b79105d7643efad780b8051e421251d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.814Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-810239cb28f5303eb18b9619: start","job_status":"start","queue_duration_s":1.151982,"scheduling_latency_s":1.152002}1380gitlab # [ 252.993737] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.978Z","message":"No existing merge request to be cleaned up."}1381gitlab # [ 252.995363] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:57:17.988Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"810239cb28f5303eb18b9619","created_at":"2026-08-20T05:57:16.799Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-49c3bc959eb2416e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5b79105d7643efad780b8051e421251d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:16.814Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-810239cb28f5303eb18b9619: done: 0.021701 sec","job_status":"done","queue_duration_s":1.151982,"scheduling_latency_s":1.152002,"redis_calls":10,"redis_duration_s":0.00139,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000596,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000794,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014222,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021701,"completed_at":"2026-08-20T05:57:17.988Z","load_balancing_strategy":"primary","db_duration_s":0.002944,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1382gitlab # [ 282.269363] setup-gitlab-start[3023]: W, [2026-08-20T05:57:49.060422 #3023] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1383gitlab # [ 294.736615] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:01.527Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"e0b7933111fe3d41e9882bbd","created_at":"2026-08-20T05:58:01.500Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9742c1832822b39f660f8810c072e0a2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:01.523Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-e0b7933111fe3d41e9882bbd: start","job_status":"start","queue_duration_s":0.003673,"scheduling_latency_s":0.003736}1384gitlab # [ 294.947010] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:01.738Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"e0b7933111fe3d41e9882bbd","created_at":"2026-08-20T05:58:01.500Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9742c1832822b39f660f8810c072e0a2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:01.523Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-e0b7933111fe3d41e9882bbd: done: 0.211197 sec","job_status":"done","queue_duration_s":0.003673,"scheduling_latency_s":0.003736,"redis_calls":16,"redis_duration_s":0.03936,"redis_read_bytes":1157,"redis_write_bytes":1369,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.022934,"redis_feature_flag_read_bytes":1152,"redis_feature_flag_write_bytes":593,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.01207,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004356,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04415,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.211197,"completed_at":"2026-08-20T05:58:01.738Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1385gitlab # [ 295.043565] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:01.746Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"de41f1c6f86b4fc0ef955483","created_at":"2026-08-20T05:58:01.541Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7b9fb47210c5071d7450ca49e5f6b641","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T05:58:01.548Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-de41f1c6f86b4fc0ef955483: start","job_status":"start","queue_duration_s":0.198133,"scheduling_latency_s":0.19819}1386gitlab # [ 295.082279] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:01.873Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"de41f1c6f86b4fc0ef955483","created_at":"2026-08-20T05:58:01.541Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7b9fb47210c5071d7450ca49e5f6b641","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T05:58:01.548Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-de41f1c6f86b4fc0ef955483: done: 0.127102 sec","job_status":"done","queue_duration_s":0.198133,"scheduling_latency_s":0.19819,"redis_calls":7,"redis_duration_s":0.026795000000000003,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.024393,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002402,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042923,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.127102,"completed_at":"2026-08-20T05:58:01.873Z","load_balancing_strategy":"primary","db_duration_s":0.008251,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1387gitlab # [ 295.148780] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:01.881Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"ba3d948ed82fa36a30bfc1f1","created_at":"2026-08-20T05:58:01.580Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f26b84c80744002dfb23778f9fd7aac6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T05:58:01.588Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-ba3d948ed82fa36a30bfc1f1: start","job_status":"start","queue_duration_s":0.292867,"scheduling_latency_s":0.292925}1388gitlab # [ 295.164058] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:01.942Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1389gitlab # [ 295.189872] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:01.981Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"ba3d948ed82fa36a30bfc1f1","created_at":"2026-08-20T05:58:01.580Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f26b84c80744002dfb23778f9fd7aac6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T05:58:01.588Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-ba3d948ed82fa36a30bfc1f1: done: 0.100213 sec","job_status":"done","queue_duration_s":0.292867,"scheduling_latency_s":0.292925,"redis_calls":7,"redis_duration_s":0.016675,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.012258,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004417,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027427,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.100213,"completed_at":"2026-08-20T05:58:01.981Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1390gitlab # [ 295.251218] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:01.989Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"a9fbdd1b3fc68f77e5544110","created_at":"2026-08-20T05:58:01.611Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3191b4a405c87817185f77d7b1f1a547","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:01.649Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-a9fbdd1b3fc68f77e5544110: start","job_status":"start","queue_duration_s":0.339974,"scheduling_latency_s":0.34003}1391gitlab # [ 295.324241] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:02.115Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"a9fbdd1b3fc68f77e5544110","created_at":"2026-08-20T05:58:01.611Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3191b4a405c87817185f77d7b1f1a547","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:01.649Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-a9fbdd1b3fc68f77e5544110: done: 0.125931 sec","job_status":"done","queue_duration_s":0.339974,"scheduling_latency_s":0.34003,"redis_calls":12,"redis_duration_s":0.019251,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.003244,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004166,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.009715,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002126,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039408,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00069246,"duration_s":0.125931,"completed_at":"2026-08-20T05:58:02.115Z","load_balancing_strategy":"primary","db_duration_s":0.009294,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392gitlab # [ 295.404043] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:02.123Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"c594042d97d74d178819b997","created_at":"2026-08-20T05:58:01.675Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"987b28aee1b54eab3697091099c6b35f","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:01.687Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-c594042d97d74d178819b997: start","job_status":"start","queue_duration_s":0.436099,"scheduling_latency_s":0.436155}1393gitlab # [ 295.421784] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:02.212Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"c594042d97d74d178819b997","created_at":"2026-08-20T05:58:01.675Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"987b28aee1b54eab3697091099c6b35f","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:01.687Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-c594042d97d74d178819b997: done: 0.089264 sec","job_status":"done","queue_duration_s":0.436099,"scheduling_latency_s":0.436155,"redis_calls":10,"redis_duration_s":0.018712,"redis_read_bytes":135,"redis_write_bytes":1136,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.00061,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":49,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.008706,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.009396,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035517,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0031531,"exclusive_lock_hold_duration_s":0.01550314,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.089264,"completed_at":"2026-08-20T05:58:02.212Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008575,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1394gitlab # [ 295.469851] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:02.218Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"3e4390969ffe2eded8c0ff41","created_at":"2026-08-20T05:58:01.728Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"34b1660faa4c60730f2206f67b7eb352","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:01.734Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-3e4390969ffe2eded8c0ff41: start","job_status":"start","queue_duration_s":0.483507,"scheduling_latency_s":0.483564}1395gitlab # [ 296.180719] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:02.971Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"3e4390969ffe2eded8c0ff41","created_at":"2026-08-20T05:58:01.728Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"34b1660faa4c60730f2206f67b7eb352","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:01.734Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-3e4390969ffe2eded8c0ff41: done: 0.753204 sec","job_status":"done","queue_duration_s":0.483507,"scheduling_latency_s":0.483564,"redis_calls":562,"redis_duration_s":0.368223,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001663,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.36656,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.438747,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.753204,"completed_at":"2026-08-20T05:58:02.971Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1396gitlab # [ 296.181251] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:02.973Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"95999b8478af9315e0ce4696","created_at":"2026-08-20T05:58:01.765Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b16686f26d944647012cff47ed96f77a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:01.774Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-95999b8478af9315e0ce4696: start","job_status":"start","queue_duration_s":1.199171,"scheduling_latency_s":1.199198}1397gitlab # [ 296.481696] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.273Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"95999b8478af9315e0ce4696","created_at":"2026-08-20T05:58:01.765Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b16686f26d944647012cff47ed96f77a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:01.774Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-95999b8478af9315e0ce4696: done: 0.30015 sec","job_status":"done","queue_duration_s":1.199171,"scheduling_latency_s":1.199198,"redis_calls":11,"redis_duration_s":0.003096,"redis_read_bytes":9,"redis_write_bytes":1262,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000552,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":275,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001282,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001262,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.064,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":130,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.064,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.219295,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00063954,"exclusive_lock_hold_duration_s":0.278837,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.30015,"completed_at":"2026-08-20T05:58:03.273Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.093091,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1398gitlab # [ 296.595948] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.275Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"26b77b00bf1dc5bbfa70c3e0","created_at":"2026-08-20T05:58:01.810Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a3151552e9a72ba7146a51962ffa2144","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:01.838Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-26b77b00bf1dc5bbfa70c3e0: start","job_status":"start","queue_duration_s":1.437164,"scheduling_latency_s":1.437188}1399gitlab # [ 296.617619] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.293Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"26b77b00bf1dc5bbfa70c3e0","created_at":"2026-08-20T05:58:01.810Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a3151552e9a72ba7146a51962ffa2144","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:01.838Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-26b77b00bf1dc5bbfa70c3e0: done: 0.018292 sec","job_status":"done","queue_duration_s":1.437164,"scheduling_latency_s":1.437188,"redis_calls":7,"redis_duration_s":0.0019579999999999997,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001383,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000575,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010293,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018292,"completed_at":"2026-08-20T05:58:03.293Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001949,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1400gitlab # [ 296.667991] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.295Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"950952a4db7fc73bd6ac6918","created_at":"2026-08-20T05:58:01.862Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0dc5fe90fd7ab39f3a74644b040fe8d2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:01.870Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-950952a4db7fc73bd6ac6918: start","job_status":"start","queue_duration_s":1.425256,"scheduling_latency_s":1.425279}1401gitlab # [ 296.682781] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.348Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"950952a4db7fc73bd6ac6918","created_at":"2026-08-20T05:58:01.862Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0dc5fe90fd7ab39f3a74644b040fe8d2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:01.870Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-950952a4db7fc73bd6ac6918: done: 0.053274 sec","job_status":"done","queue_duration_s":1.425256,"scheduling_latency_s":1.425279,"redis_calls":9,"redis_duration_s":0.00307,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001417,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001653,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.027,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01955,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00097458,"exclusive_lock_hold_duration_s":0.02182794,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.053274,"completed_at":"2026-08-20T05:58:03.348Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027855,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1402gitlab # [ 296.728236] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.350Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"49d6654595d65e70925f512b","created_at":"2026-08-20T05:58:01.889Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4d625518d2abdf488546dac6b14126cd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:01.896Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-49d6654595d65e70925f512b: start","job_status":"start","queue_duration_s":1.453963,"scheduling_latency_s":1.453987}1403gitlab # [ 296.743567] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.408Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"49d6654595d65e70925f512b","created_at":"2026-08-20T05:58:01.889Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4d625518d2abdf488546dac6b14126cd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:01.896Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-49d6654595d65e70925f512b: done: 0.058151 sec","job_status":"done","queue_duration_s":1.453963,"scheduling_latency_s":1.453987,"redis_calls":9,"redis_duration_s":0.003267,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001296,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001971,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.015,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026246,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00076594,"exclusive_lock_hold_duration_s":0.03912954,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.058151,"completed_at":"2026-08-20T05:58:03.408Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.030817,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404gitlab # [ 296.790365] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.410Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"9c419cbaeee7c5a9af66e839","created_at":"2026-08-20T05:58:01.912Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a41ad1da299473ea1eee1a7541e6e8b1","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:01.946Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-9c419cbaeee7c5a9af66e839: start","job_status":"start","queue_duration_s":1.464154,"scheduling_latency_s":1.464178}1405gitlab # [ 296.805622] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.444Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"9c419cbaeee7c5a9af66e839","created_at":"2026-08-20T05:58:01.912Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a41ad1da299473ea1eee1a7541e6e8b1","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:01.946Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-9c419cbaeee7c5a9af66e839: done: 0.034352 sec","job_status":"done","queue_duration_s":1.464154,"scheduling_latency_s":1.464178,"redis_calls":10,"redis_duration_s":0.001705,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000423,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000921,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000361,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018289,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026664,"duration_s":0.034352,"completed_at":"2026-08-20T05:58:03.444Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008827,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1406gitlab # [ 296.849575] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.446Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"3be81f3d0cbf4063bc900953","created_at":"2026-08-20T05:58:01.970Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"346e7d0231e780f8e51e3e61223810b1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:01.977Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-3be81f3d0cbf4063bc900953: start","job_status":"start","queue_duration_s":1.468664,"scheduling_latency_s":1.468685}1407gitlab # [ 296.864782] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.453Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1408gitlab # [ 296.868166] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.459Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"3be81f3d0cbf4063bc900953","created_at":"2026-08-20T05:58:01.970Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"346e7d0231e780f8e51e3e61223810b1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:01.977Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-3be81f3d0cbf4063bc900953: done: 0.013294 sec","job_status":"done","queue_duration_s":1.468664,"scheduling_latency_s":1.468685,"redis_calls":7,"redis_duration_s":0.0010299999999999999,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000743,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000287,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008299,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013294,"completed_at":"2026-08-20T05:58:03.459Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1409gitlab # [ 296.910201] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.460Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"dfde9e29d99885a6fafd1fba","created_at":"2026-08-20T05:58:02.005Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e9d651f4e5e63070389c5de010b15d05","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:02.012Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-dfde9e29d99885a6fafd1fba: start","job_status":"start","queue_duration_s":1.448216,"scheduling_latency_s":1.448237}1410gitlab # [ 296.924646] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.491Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"dfde9e29d99885a6fafd1fba","created_at":"2026-08-20T05:58:02.005Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e9d651f4e5e63070389c5de010b15d05","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:02.012Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-dfde9e29d99885a6fafd1fba: done: 0.030619 sec","job_status":"done","queue_duration_s":1.448216,"scheduling_latency_s":1.448237,"redis_calls":7,"redis_duration_s":0.0011020000000000001,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000805,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000297,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009903,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.030619,"completed_at":"2026-08-20T05:58:03.491Z","load_balancing_strategy":"primary","db_duration_s":0.015929,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1411gitlab # [ 296.967342] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.492Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"6b96f16639b01731445e1a90","created_at":"2026-08-20T05:58:02.046Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d86bc520a1aa0f4f3acb11adffa8252c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:02.057Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-6b96f16639b01731445e1a90: start","job_status":"start","queue_duration_s":1.434931,"scheduling_latency_s":1.434954}1412gitlab # [ 296.983892] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.506Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"6b96f16639b01731445e1a90","created_at":"2026-08-20T05:58:02.046Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d86bc520a1aa0f4f3acb11adffa8252c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:02.057Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-6b96f16639b01731445e1a90: done: 0.013472 sec","job_status":"done","queue_duration_s":1.434931,"scheduling_latency_s":1.434954,"redis_calls":7,"redis_duration_s":0.001051,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00075,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000301,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008554,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013472,"completed_at":"2026-08-20T05:58:03.506Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1413gitlab # [ 297.026221] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.507Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"a4b376b004a902b7fb5cc68e","created_at":"2026-08-20T05:58:02.083Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"db50da9d3960894ef4043de7a9d25b5f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:02.110Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-a4b376b004a902b7fb5cc68e: start","job_status":"start","queue_duration_s":1.397041,"scheduling_latency_s":1.397064}1414gitlab # [ 297.041345] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.515Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1415gitlab # [ 297.045246] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.521Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"a4b376b004a902b7fb5cc68e","created_at":"2026-08-20T05:58:02.083Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"db50da9d3960894ef4043de7a9d25b5f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:02.110Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-a4b376b004a902b7fb5cc68e: done: 0.013842 sec","job_status":"done","queue_duration_s":1.397041,"scheduling_latency_s":1.397064,"redis_calls":7,"redis_duration_s":0.0014609999999999998,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001076,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000385,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008524,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013842,"completed_at":"2026-08-20T05:58:03.521Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1416gitlab # [ 297.087404] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.522Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"f9656e5ccebd43be89e7372a","created_at":"2026-08-20T05:58:02.133Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bbaed06fee5efb80afb22b1c2b12507f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T05:58:02.139Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-f9656e5ccebd43be89e7372a: start","job_status":"start","queue_duration_s":1.383216,"scheduling_latency_s":1.383237}1417gitlab # [ 297.101398] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.530Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1418gitlab # [ 297.104765] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.536Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"f9656e5ccebd43be89e7372a","created_at":"2026-08-20T05:58:02.133Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bbaed06fee5efb80afb22b1c2b12507f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T05:58:02.139Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-f9656e5ccebd43be89e7372a: done: 0.013336 sec","job_status":"done","queue_duration_s":1.383216,"scheduling_latency_s":1.383237,"redis_calls":7,"redis_duration_s":0.001137,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000802,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000335,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008277,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013336,"completed_at":"2026-08-20T05:58:03.535Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1419gitlab # [ 297.145489] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.537Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"24cd52f09733fa73ebd2830f","created_at":"2026-08-20T05:58:02.173Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9e57feb03ebb9b3c1c846d582b9eda04","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:02.339Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-24cd52f09733fa73ebd2830f: start","job_status":"start","queue_duration_s":1.197496,"scheduling_latency_s":1.197517}1420gitlab # [ 297.160365] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.563Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"24cd52f09733fa73ebd2830f","created_at":"2026-08-20T05:58:02.173Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9e57feb03ebb9b3c1c846d582b9eda04","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:02.339Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-24cd52f09733fa73ebd2830f: done: 0.025813 sec","job_status":"done","queue_duration_s":1.197496,"scheduling_latency_s":1.197517,"redis_calls":12,"redis_duration_s":0.001717,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000291,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000759,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000667,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014781,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000484,"exclusive_lock_hold_duration_s":0.00714082,"duration_s":0.025813,"completed_at":"2026-08-20T05:58:03.563Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004701,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1421gitlab # [ 297.205344] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.564Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"aed4195ef195e0a622103411","created_at":"2026-08-20T05:58:02.431Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"007f41349865f7a744440b4da2d07b56","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:02.439Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-aed4195ef195e0a622103411: start","job_status":"start","queue_duration_s":1.124869,"scheduling_latency_s":1.124888}1422gitlab # [ 297.220265] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.571Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1423gitlab # [ 297.223461] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.576Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"aed4195ef195e0a622103411","created_at":"2026-08-20T05:58:02.431Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"007f41349865f7a744440b4da2d07b56","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:02.439Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-aed4195ef195e0a622103411: done: 0.012431 sec","job_status":"done","queue_duration_s":1.124869,"scheduling_latency_s":1.124888,"redis_calls":7,"redis_duration_s":0.000962,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000688,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000274,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007852,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012431,"completed_at":"2026-08-20T05:58:03.576Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1424gitlab # [ 297.265196] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.578Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"728c9f54954b912096d57ef6","created_at":"2026-08-20T05:58:02.471Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"79bee8c621643e529e715955666c1e3f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:02.479Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-728c9f54954b912096d57ef6: start","job_status":"start","queue_duration_s":1.098477,"scheduling_latency_s":1.098496}1425gitlab # [ 297.279598] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.595Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"728c9f54954b912096d57ef6","created_at":"2026-08-20T05:58:02.471Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"79bee8c621643e529e715955666c1e3f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:02.479Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-728c9f54954b912096d57ef6: done: 0.017168 sec","job_status":"done","queue_duration_s":1.098477,"scheduling_latency_s":1.098496,"redis_calls":9,"redis_duration_s":0.0013830000000000001,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00072,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000663,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010856,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00047218,"exclusive_lock_hold_duration_s":0.00423002,"duration_s":0.017168,"completed_at":"2026-08-20T05:58:03.595Z","load_balancing_strategy":"primary","db_duration_s":0.00194,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1426gitlab # [ 297.321344] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.596Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"9e74b35d026f166767eaf03c","created_at":"2026-08-20T05:58:02.509Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c7c7cef10f354367f104c265ea2e142b","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:02.519Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-9e74b35d026f166767eaf03c: start","job_status":"start","queue_duration_s":1.076477,"scheduling_latency_s":1.076496}1427gitlab # [ 297.336074] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.620Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"9e74b35d026f166767eaf03c","created_at":"2026-08-20T05:58:02.509Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c7c7cef10f354367f104c265ea2e142b","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:02.519Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-9e74b35d026f166767eaf03c: done: 0.023948 sec","job_status":"done","queue_duration_s":1.076477,"scheduling_latency_s":1.076496,"redis_calls":7,"redis_duration_s":0.001054,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000761,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000293,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011845,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023948,"completed_at":"2026-08-20T05:58:03.620Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006802,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1428gitlab # [ 297.378649] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.621Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"7faffc83089c2cf8eac09a1d","created_at":"2026-08-20T05:58:02.558Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:02.567Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-7faffc83089c2cf8eac09a1d: start","job_status":"start","queue_duration_s":1.053656,"scheduling_latency_s":1.053675}1429gitlab # [ 297.392826] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.711Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"7faffc83089c2cf8eac09a1d","created_at":"2026-08-20T05:58:02.558Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:02.567Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-7faffc83089c2cf8eac09a1d: done: 0.090384 sec","job_status":"done","queue_duration_s":1.053656,"scheduling_latency_s":1.053675,"redis_calls":60,"redis_duration_s":0.009177,"redis_read_bytes":108,"redis_write_bytes":41109,"redis_queues_calls":2,"redis_queues_duration_s":0.000547,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.008201,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000429,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.083017,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.090384,"completed_at":"2026-08-20T05:58:03.711Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1430gitlab # [ 297.435447] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.713Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"ab442c63880b99f1fc62526f","created_at":"2026-08-20T05:58:02.618Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"281fb20cea98f107352160c49de4b51f","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:02.631Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-ab442c63880b99f1fc62526f: start","job_status":"start","queue_duration_s":1.081505,"scheduling_latency_s":1.081529}1431gitlab # [ 297.450662] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.736Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"ab442c63880b99f1fc62526f","created_at":"2026-08-20T05:58:02.618Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"281fb20cea98f107352160c49de4b51f","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:02.631Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-ab442c63880b99f1fc62526f: done: 0.023403 sec","job_status":"done","queue_duration_s":1.081505,"scheduling_latency_s":1.081529,"redis_calls":10,"redis_duration_s":0.001579,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000901,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000678,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014131,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00719074,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.023403,"completed_at":"2026-08-20T05:58:03.736Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004319,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1432gitlab # [ 297.494416] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.737Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"ca890c7bcc3924b116f845d8","created_at":"2026-08-20T05:58:02.651Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f5e2694e7f4918ce79a62ed5463e001d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:02.661Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-ca890c7bcc3924b116f845d8: start","job_status":"start","queue_duration_s":1.076078,"scheduling_latency_s":1.076099}1433gitlab # [ 297.509605] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.745Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1434gitlab # [ 297.513283] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.750Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"ca890c7bcc3924b116f845d8","created_at":"2026-08-20T05:58:02.651Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f5e2694e7f4918ce79a62ed5463e001d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:02.661Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-ca890c7bcc3924b116f845d8: done: 0.012518 sec","job_status":"done","queue_duration_s":1.076078,"scheduling_latency_s":1.076099,"redis_calls":7,"redis_duration_s":0.000984,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000706,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000278,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007957,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012518,"completed_at":"2026-08-20T05:58:03.750Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1435gitlab # [ 297.554536] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.751Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"d845f585aeeb0bc81d0ab6fe","created_at":"2026-08-20T05:58:02.680Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6f6cf9bd251f1068a060e230476f1138","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:02.689Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-d845f585aeeb0bc81d0ab6fe: start","job_status":"start","queue_duration_s":1.062286,"scheduling_latency_s":1.062306}1436gitlab # [ 297.568799] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.777Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"d845f585aeeb0bc81d0ab6fe","created_at":"2026-08-20T05:58:02.680Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-dbffffd99adb431f","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6f6cf9bd251f1068a060e230476f1138","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:02.689Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-d845f585aeeb0bc81d0ab6fe: done: 0.02634 sec","job_status":"done","queue_duration_s":1.062286,"scheduling_latency_s":1.062306,"redis_calls":14,"redis_duration_s":0.002053,"redis_read_bytes":16,"redis_write_bytes":4030,"redis_queues_calls":2,"redis_queues_duration_s":0.000228,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001381,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000444,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019385,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02634,"completed_at":"2026-08-20T05:58:03.777Z","load_balancing_strategy":"primary","db_duration_s":0.002261,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1437gitlab # [ 297.612157] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.779Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b9476fd75bfc4e5b50b961ae","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b9476fd75bfc4e5b50b961ae: start","job_status":"start","queue_duration_s":0.074303,"scheduling_latency_s":0.074323}1438gitlab # [ 297.624960] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.794Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b9476fd75bfc4e5b50b961ae","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b9476fd75bfc4e5b50b961ae: done: 0.014934 sec","job_status":"done","queue_duration_s":0.074303,"scheduling_latency_s":0.074323,"redis_calls":13,"redis_duration_s":0.001692,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0006,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001092,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010134,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014934,"completed_at":"2026-08-20T05:58:03.794Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1439gitlab # [ 297.665669] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.795Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"11e3741d07009ce0113ece61","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-11e3741d07009ce0113ece61: start","job_status":"start","queue_duration_s":0.090436,"scheduling_latency_s":0.090455}1440gitlab # [ 297.678991] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.809Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"11e3741d07009ce0113ece61","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-11e3741d07009ce0113ece61: done: 0.014647 sec","job_status":"done","queue_duration_s":0.090436,"scheduling_latency_s":0.090455,"redis_calls":13,"redis_duration_s":0.001682,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000625,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001057,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00999,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014647,"completed_at":"2026-08-20T05:58:03.809Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1441gitlab # [ 297.720640] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.811Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e8950883b16210f6d44c73b","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e8950883b16210f6d44c73b: start","job_status":"start","queue_duration_s":0.106254,"scheduling_latency_s":0.106273}1442gitlab # [ 297.733517] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.825Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e8950883b16210f6d44c73b","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e8950883b16210f6d44c73b: done: 0.014568 sec","job_status":"done","queue_duration_s":0.106254,"scheduling_latency_s":0.106273,"redis_calls":13,"redis_duration_s":0.0015040000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000967,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009837,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014568,"completed_at":"2026-08-20T05:58:03.825Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1443gitlab # [ 297.773843] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.826Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"18fcd3b02b2a3190a389ef8e","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-18fcd3b02b2a3190a389ef8e: start","job_status":"start","queue_duration_s":0.121935,"scheduling_latency_s":0.121953}1444gitlab # [ 297.787961] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.840Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"18fcd3b02b2a3190a389ef8e","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-18fcd3b02b2a3190a389ef8e: done: 0.013984 sec","job_status":"done","queue_duration_s":0.121935,"scheduling_latency_s":0.121953,"redis_calls":13,"redis_duration_s":0.001483,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000951,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009528,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013984,"completed_at":"2026-08-20T05:58:03.840Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1445gitlab # [ 297.829138] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.841Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fde71610d287eb697b3862ab","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fde71610d287eb697b3862ab: start","job_status":"start","queue_duration_s":0.137006,"scheduling_latency_s":0.137024}1446gitlab # [ 297.842069] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.855Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fde71610d287eb697b3862ab","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fde71610d287eb697b3862ab: done: 0.014035 sec","job_status":"done","queue_duration_s":0.137006,"scheduling_latency_s":0.137024,"redis_calls":13,"redis_duration_s":0.001501,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000957,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009655,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014035,"completed_at":"2026-08-20T05:58:03.855Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1447gitlab # [ 297.883170] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.857Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d7db5d57f79e8ae47e91ceff","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d7db5d57f79e8ae47e91ceff: start","job_status":"start","queue_duration_s":0.152183,"scheduling_latency_s":0.152201}1448gitlab # [ 297.896511] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.871Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d7db5d57f79e8ae47e91ceff","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d7db5d57f79e8ae47e91ceff: done: 0.014012 sec","job_status":"done","queue_duration_s":0.152183,"scheduling_latency_s":0.152201,"redis_calls":13,"redis_duration_s":0.0015409999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001009,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009631,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014012,"completed_at":"2026-08-20T05:58:03.871Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1449gitlab # [ 297.936957] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.872Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4f4fac524d67f0e4f385ccf","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4f4fac524d67f0e4f385ccf: start","job_status":"start","queue_duration_s":0.167332,"scheduling_latency_s":0.167351}1450gitlab # [ 297.949837] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.886Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4f4fac524d67f0e4f385ccf","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4f4fac524d67f0e4f385ccf: done: 0.014435 sec","job_status":"done","queue_duration_s":0.167332,"scheduling_latency_s":0.167351,"redis_calls":13,"redis_duration_s":0.0015539999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001006,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00973,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014435,"completed_at":"2026-08-20T05:58:03.886Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1451gitlab # [ 297.991485] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.887Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e0b52572c29f22339e560b3","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e0b52572c29f22339e560b3: start","job_status":"start","queue_duration_s":0.182976,"scheduling_latency_s":0.182996}1452gitlab # [ 298.004554] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.902Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e0b52572c29f22339e560b3","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e0b52572c29f22339e560b3: done: 0.014239 sec","job_status":"done","queue_duration_s":0.182976,"scheduling_latency_s":0.182996,"redis_calls":13,"redis_duration_s":0.0015670000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000568,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000999,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009751,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014239,"completed_at":"2026-08-20T05:58:03.902Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1453gitlab # [ 298.045047] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.903Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"46b312111579cc573926ab45","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-46b312111579cc573926ab45: start","job_status":"start","queue_duration_s":0.19837,"scheduling_latency_s":0.198389}1454gitlab # [ 298.057927] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.918Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"46b312111579cc573926ab45","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-46b312111579cc573926ab45: done: 0.014896 sec","job_status":"done","queue_duration_s":0.19837,"scheduling_latency_s":0.198389,"redis_calls":13,"redis_duration_s":0.001879,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000824,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001055,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010066,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014896,"completed_at":"2026-08-20T05:58:03.918Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1455gitlab # [ 298.098536] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.919Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"515870b3cd3444e5f0091a97","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-515870b3cd3444e5f0091a97: start","job_status":"start","queue_duration_s":0.214447,"scheduling_latency_s":0.214465}1456gitlab # [ 298.111598] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.933Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"515870b3cd3444e5f0091a97","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-515870b3cd3444e5f0091a97: done: 0.014136 sec","job_status":"done","queue_duration_s":0.214447,"scheduling_latency_s":0.214465,"redis_calls":13,"redis_duration_s":0.0015300000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001002,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009665,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014136,"completed_at":"2026-08-20T05:58:03.933Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1457gitlab # [ 298.153074] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.934Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d56b6ebc53f18f2543529603","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d56b6ebc53f18f2543529603: start","job_status":"start","queue_duration_s":0.229692,"scheduling_latency_s":0.22971}1458gitlab # [ 298.165590] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.948Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d56b6ebc53f18f2543529603","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d56b6ebc53f18f2543529603: done: 0.013926 sec","job_status":"done","queue_duration_s":0.229692,"scheduling_latency_s":0.22971,"redis_calls":13,"redis_duration_s":0.001459,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000929,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009603,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013926,"completed_at":"2026-08-20T05:58:03.948Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1459gitlab # [ 298.207724] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.949Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b21d14262c2ee6b18e2b48c2","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b21d14262c2ee6b18e2b48c2: start","job_status":"start","queue_duration_s":0.244718,"scheduling_latency_s":0.244736}1460gitlab # [ 298.220911] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.963Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b21d14262c2ee6b18e2b48c2","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b21d14262c2ee6b18e2b48c2: done: 0.013853 sec","job_status":"done","queue_duration_s":0.244718,"scheduling_latency_s":0.244736,"redis_calls":13,"redis_duration_s":0.001471,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000932,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009585,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013853,"completed_at":"2026-08-20T05:58:03.963Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1461gitlab # [ 298.261442] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.964Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b0d6d8e89d63dcf4d5ce73c","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b0d6d8e89d63dcf4d5ce73c: start","job_status":"start","queue_duration_s":0.259702,"scheduling_latency_s":0.25972}1462gitlab # [ 298.274455] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.978Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b0d6d8e89d63dcf4d5ce73c","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b0d6d8e89d63dcf4d5ce73c: done: 0.013989 sec","job_status":"done","queue_duration_s":0.259702,"scheduling_latency_s":0.25972,"redis_calls":13,"redis_duration_s":0.0015249999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000998,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009585,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013989,"completed_at":"2026-08-20T05:58:03.978Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1463gitlab # [ 298.315316] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.979Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"718e7f4dddc3947832e79922","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-718e7f4dddc3947832e79922: start","job_status":"start","queue_duration_s":0.274819,"scheduling_latency_s":0.274838}1464gitlab # [ 298.328455] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.993Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"718e7f4dddc3947832e79922","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-718e7f4dddc3947832e79922: done: 0.013924 sec","job_status":"done","queue_duration_s":0.274819,"scheduling_latency_s":0.274838,"redis_calls":13,"redis_duration_s":0.0014889999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00096,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00961,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013924,"completed_at":"2026-08-20T05:58:03.993Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1465gitlab # [ 298.369374] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:03.994Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0bf4c71b936a68b2700a80aa","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0bf4c71b936a68b2700a80aa: start","job_status":"start","queue_duration_s":0.289873,"scheduling_latency_s":0.289891}1466gitlab # [ 298.382447] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.008Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0bf4c71b936a68b2700a80aa","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0bf4c71b936a68b2700a80aa: done: 0.013978 sec","job_status":"done","queue_duration_s":0.289873,"scheduling_latency_s":0.289891,"redis_calls":13,"redis_duration_s":0.001497,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000953,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009601,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013978,"completed_at":"2026-08-20T05:58:04.008Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1467gitlab # [ 298.424350] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.009Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0637d4ea3ae6f478e28280ca","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0637d4ea3ae6f478e28280ca: start","job_status":"start","queue_duration_s":0.305025,"scheduling_latency_s":0.305043}1468gitlab # [ 298.437325] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.024Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0637d4ea3ae6f478e28280ca","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0637d4ea3ae6f478e28280ca: done: 0.014452 sec","job_status":"done","queue_duration_s":0.305025,"scheduling_latency_s":0.305043,"redis_calls":13,"redis_duration_s":0.001548,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000557,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000991,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009808,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014452,"completed_at":"2026-08-20T05:58:04.024Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1469gitlab # [ 298.478519] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.025Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be702cdf3fa073e680a7d649","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be702cdf3fa073e680a7d649: start","job_status":"start","queue_duration_s":0.320643,"scheduling_latency_s":0.320662}1470gitlab # [ 298.491840] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.039Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be702cdf3fa073e680a7d649","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be702cdf3fa073e680a7d649: done: 0.014149 sec","job_status":"done","queue_duration_s":0.320643,"scheduling_latency_s":0.320662,"redis_calls":13,"redis_duration_s":0.001587,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000564,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001023,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009689,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014149,"completed_at":"2026-08-20T05:58:04.039Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1471gitlab # [ 298.533301] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.040Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"efadf27895b7bfea05f4d476","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-efadf27895b7bfea05f4d476: start","job_status":"start","queue_duration_s":0.336007,"scheduling_latency_s":0.336024}1472gitlab # [ 298.546324] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.055Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"efadf27895b7bfea05f4d476","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-efadf27895b7bfea05f4d476: done: 0.014278 sec","job_status":"done","queue_duration_s":0.336007,"scheduling_latency_s":0.336024,"redis_calls":13,"redis_duration_s":0.001507,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000552,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000955,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00992,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014278,"completed_at":"2026-08-20T05:58:04.055Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1473gitlab # [ 298.587980] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.056Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a75eac2db26a9e468833da79","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a75eac2db26a9e468833da79: start","job_status":"start","queue_duration_s":0.351391,"scheduling_latency_s":0.351409}1474gitlab # [ 298.602618] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.070Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a75eac2db26a9e468833da79","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a75eac2db26a9e468833da79: done: 0.013835 sec","job_status":"done","queue_duration_s":0.351391,"scheduling_latency_s":0.351409,"redis_calls":13,"redis_duration_s":0.001472,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000942,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00955,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013835,"completed_at":"2026-08-20T05:58:04.070Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1475gitlab # [ 298.643281] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.071Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c645c51b80e3c583c6def15","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c645c51b80e3c583c6def15: start","job_status":"start","queue_duration_s":0.366313,"scheduling_latency_s":0.366331}1476gitlab # [ 298.656551] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.085Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c645c51b80e3c583c6def15","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c645c51b80e3c583c6def15: done: 0.013866 sec","job_status":"done","queue_duration_s":0.366313,"scheduling_latency_s":0.366331,"redis_calls":13,"redis_duration_s":0.0015240000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000586,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000938,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00955,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013866,"completed_at":"2026-08-20T05:58:04.085Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1477gitlab # [ 298.697592] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.086Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e394d796a2a2b9c41b669b7f","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e394d796a2a2b9c41b669b7f: start","job_status":"start","queue_duration_s":0.381273,"scheduling_latency_s":0.381291}1478gitlab # [ 298.710927] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.099Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e394d796a2a2b9c41b669b7f","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e394d796a2a2b9c41b669b7f: done: 0.013785 sec","job_status":"done","queue_duration_s":0.381273,"scheduling_latency_s":0.381291,"redis_calls":13,"redis_duration_s":0.001471,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000923,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009438,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013785,"completed_at":"2026-08-20T05:58:04.099Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1479gitlab # [ 298.752862] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.101Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55123f3de9025abd667933f8","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55123f3de9025abd667933f8: start","job_status":"start","queue_duration_s":0.396213,"scheduling_latency_s":0.396231}1480gitlab # [ 298.765426] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.114Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55123f3de9025abd667933f8","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55123f3de9025abd667933f8: done: 0.013868 sec","job_status":"done","queue_duration_s":0.396213,"scheduling_latency_s":0.396231,"redis_calls":13,"redis_duration_s":0.001492,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000536,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000956,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009577,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013868,"completed_at":"2026-08-20T05:58:04.114Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1481gitlab # [ 298.808073] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.116Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"13dd0ac4204b78640892d421","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-13dd0ac4204b78640892d421: start","job_status":"start","queue_duration_s":0.411241,"scheduling_latency_s":0.41126}1482gitlab # [ 298.820876] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.130Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"13dd0ac4204b78640892d421","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-13dd0ac4204b78640892d421: done: 0.014412 sec","job_status":"done","queue_duration_s":0.411241,"scheduling_latency_s":0.41126,"redis_calls":13,"redis_duration_s":0.001545,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000994,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009675,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014412,"completed_at":"2026-08-20T05:58:04.130Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1483gitlab # [ 298.861895] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.131Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea16c0f256ca892e3ed8f878","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea16c0f256ca892e3ed8f878: start","job_status":"start","queue_duration_s":0.426813,"scheduling_latency_s":0.426832}1484gitlab # [ 298.874931] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.146Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea16c0f256ca892e3ed8f878","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea16c0f256ca892e3ed8f878: done: 0.014342 sec","job_status":"done","queue_duration_s":0.426813,"scheduling_latency_s":0.426832,"redis_calls":13,"redis_duration_s":0.0016099999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000602,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001008,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009862,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014342,"completed_at":"2026-08-20T05:58:04.146Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1485gitlab # [ 298.915897] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.147Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"61d17af233a86116bc4de231","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-61d17af233a86116bc4de231: start","job_status":"start","queue_duration_s":0.442356,"scheduling_latency_s":0.442374}1486gitlab # [ 298.929129] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.161Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"61d17af233a86116bc4de231","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-61d17af233a86116bc4de231: done: 0.014267 sec","job_status":"done","queue_duration_s":0.442356,"scheduling_latency_s":0.442374,"redis_calls":13,"redis_duration_s":0.001631,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001081,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009745,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014267,"completed_at":"2026-08-20T05:58:04.161Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1487gitlab # [ 298.970419] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.162Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e3123a6c387a5d81444ed92","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e3123a6c387a5d81444ed92: start","job_status":"start","queue_duration_s":0.457696,"scheduling_latency_s":0.457713}1488gitlab # [ 298.983477] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.176Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e3123a6c387a5d81444ed92","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e3123a6c387a5d81444ed92: done: 0.013779 sec","job_status":"done","queue_duration_s":0.457696,"scheduling_latency_s":0.457713,"redis_calls":13,"redis_duration_s":0.001467,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000938,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009471,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013779,"completed_at":"2026-08-20T05:58:04.176Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1489gitlab # [ 299.026548] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.177Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b6296ce60d93cb36851ed86","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b6296ce60d93cb36851ed86: start","job_status":"start","queue_duration_s":0.472614,"scheduling_latency_s":0.472633}1490gitlab # [ 299.039748] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.191Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b6296ce60d93cb36851ed86","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b6296ce60d93cb36851ed86: done: 0.013833 sec","job_status":"done","queue_duration_s":0.472614,"scheduling_latency_s":0.472633,"redis_calls":13,"redis_duration_s":0.00146,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000533,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000927,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009545,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013833,"completed_at":"2026-08-20T05:58:04.191Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1491gitlab # [ 299.081072] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.192Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"26fcf6bf383d2bdfef5e43ec","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-26fcf6bf383d2bdfef5e43ec: start","job_status":"start","queue_duration_s":0.487631,"scheduling_latency_s":0.487672}1492gitlab # [ 299.094013] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.206Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"26fcf6bf383d2bdfef5e43ec","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-26fcf6bf383d2bdfef5e43ec: done: 0.01396 sec","job_status":"done","queue_duration_s":0.487631,"scheduling_latency_s":0.487672,"redis_calls":13,"redis_duration_s":0.001472,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000937,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009629,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01396,"completed_at":"2026-08-20T05:58:04.206Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1493gitlab # [ 299.134499] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.207Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b8acc1c375abee864c62e99","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b8acc1c375abee864c62e99: start","job_status":"start","queue_duration_s":0.502766,"scheduling_latency_s":0.502784}1494gitlab # [ 299.147518] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.222Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b8acc1c375abee864c62e99","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b8acc1c375abee864c62e99: done: 0.014357 sec","job_status":"done","queue_duration_s":0.502766,"scheduling_latency_s":0.502784,"redis_calls":13,"redis_duration_s":0.001559,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000583,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000976,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009745,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014357,"completed_at":"2026-08-20T05:58:04.221Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1495gitlab # [ 299.188676] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.223Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd3d30f7e8d911a47c4a1bd4","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd3d30f7e8d911a47c4a1bd4: start","job_status":"start","queue_duration_s":0.518272,"scheduling_latency_s":0.51829}1496gitlab # [ 299.201593] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.237Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd3d30f7e8d911a47c4a1bd4","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd3d30f7e8d911a47c4a1bd4: done: 0.01415 sec","job_status":"done","queue_duration_s":0.518272,"scheduling_latency_s":0.51829,"redis_calls":13,"redis_duration_s":0.001523,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000562,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000961,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00966,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01415,"completed_at":"2026-08-20T05:58:04.237Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1497gitlab # [ 299.243749] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.238Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"723f2d6d2e7d8488566ef270","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-723f2d6d2e7d8488566ef270: start","job_status":"start","queue_duration_s":0.53356,"scheduling_latency_s":0.533579}1498gitlab # [ 299.256905] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.252Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"723f2d6d2e7d8488566ef270","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-723f2d6d2e7d8488566ef270: done: 0.014332 sec","job_status":"done","queue_duration_s":0.53356,"scheduling_latency_s":0.533579,"redis_calls":13,"redis_duration_s":0.001589,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000583,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001006,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00983,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014332,"completed_at":"2026-08-20T05:58:04.252Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1499gitlab # [ 299.297624] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.254Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e8081f97367bd343afa4c1c","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e8081f97367bd343afa4c1c: start","job_status":"start","queue_duration_s":0.549059,"scheduling_latency_s":0.549077}1500gitlab # [ 299.310532] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.268Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e8081f97367bd343afa4c1c","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e8081f97367bd343afa4c1c: done: 0.014352 sec","job_status":"done","queue_duration_s":0.549059,"scheduling_latency_s":0.549077,"redis_calls":13,"redis_duration_s":0.001595,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000604,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000991,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009762,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014352,"completed_at":"2026-08-20T05:58:04.268Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1501gitlab # [ 299.351559] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.269Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f0cf718aa29185d69ec3c8b9","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f0cf718aa29185d69ec3c8b9: start","job_status":"start","queue_duration_s":0.56457,"scheduling_latency_s":0.564588}1502gitlab # [ 299.364476] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.283Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f0cf718aa29185d69ec3c8b9","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f0cf718aa29185d69ec3c8b9: done: 0.013793 sec","job_status":"done","queue_duration_s":0.56457,"scheduling_latency_s":0.564588,"redis_calls":13,"redis_duration_s":0.001448,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000919,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009521,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013793,"completed_at":"2026-08-20T05:58:04.283Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1503gitlab # [ 299.405180] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.284Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ee54e6e4bc5d0e68597b28e","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ee54e6e4bc5d0e68597b28e: start","job_status":"start","queue_duration_s":0.579481,"scheduling_latency_s":0.579499}1504gitlab # [ 299.419211] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.298Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ee54e6e4bc5d0e68597b28e","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ee54e6e4bc5d0e68597b28e: done: 0.013794 sec","job_status":"done","queue_duration_s":0.579481,"scheduling_latency_s":0.579499,"redis_calls":13,"redis_duration_s":0.001464,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000939,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009506,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013794,"completed_at":"2026-08-20T05:58:04.298Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1505gitlab # [ 299.459859] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.299Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"487f12fbdb759f2fe70c83a3","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-487f12fbdb759f2fe70c83a3: start","job_status":"start","queue_duration_s":0.594359,"scheduling_latency_s":0.594377}1506gitlab # [ 299.472960] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.313Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"487f12fbdb759f2fe70c83a3","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-487f12fbdb759f2fe70c83a3: done: 0.014051 sec","job_status":"done","queue_duration_s":0.594359,"scheduling_latency_s":0.594377,"redis_calls":13,"redis_duration_s":0.001532,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000553,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000979,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009665,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014051,"completed_at":"2026-08-20T05:58:04.313Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1507gitlab # [ 299.513284] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.314Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7427456cea8ee7c5f75bc1fc","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7427456cea8ee7c5f75bc1fc: start","job_status":"start","queue_duration_s":0.609562,"scheduling_latency_s":0.60958}1508gitlab # [ 299.526131] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.329Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7427456cea8ee7c5f75bc1fc","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7427456cea8ee7c5f75bc1fc: done: 0.014798 sec","job_status":"done","queue_duration_s":0.609562,"scheduling_latency_s":0.60958,"redis_calls":13,"redis_duration_s":0.001608,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000601,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001007,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010004,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014798,"completed_at":"2026-08-20T05:58:04.329Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1509gitlab # [ 299.566672] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.330Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ba37f412d340700409d6ea2","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ba37f412d340700409d6ea2: start","job_status":"start","queue_duration_s":0.625504,"scheduling_latency_s":0.625522}1510gitlab # [ 299.579594] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.344Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ba37f412d340700409d6ea2","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ba37f412d340700409d6ea2: done: 0.014439 sec","job_status":"done","queue_duration_s":0.625504,"scheduling_latency_s":0.625522,"redis_calls":13,"redis_duration_s":0.001593,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00057,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001023,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009846,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014439,"completed_at":"2026-08-20T05:58:04.344Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1511gitlab # [ 299.621812] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.346Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e5a5befcf1babe9d3eb552df","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e5a5befcf1babe9d3eb552df: start","job_status":"start","queue_duration_s":0.641106,"scheduling_latency_s":0.641124}1512gitlab # [ 299.634784] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.360Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e5a5befcf1babe9d3eb552df","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e5a5befcf1babe9d3eb552df: done: 0.014163 sec","job_status":"done","queue_duration_s":0.641106,"scheduling_latency_s":0.641124,"redis_calls":13,"redis_duration_s":0.001515,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000568,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000947,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009713,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014163,"completed_at":"2026-08-20T05:58:04.360Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1513gitlab # [ 299.675119] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.361Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a86bd21b849f14031176fc84","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a86bd21b849f14031176fc84: start","job_status":"start","queue_duration_s":0.656398,"scheduling_latency_s":0.656416}1514gitlab # [ 299.688211] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.375Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a86bd21b849f14031176fc84","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a86bd21b849f14031176fc84: done: 0.014248 sec","job_status":"done","queue_duration_s":0.656398,"scheduling_latency_s":0.656416,"redis_calls":13,"redis_duration_s":0.0015379999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000561,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000977,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009799,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014248,"completed_at":"2026-08-20T05:58:04.375Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1515gitlab # [ 299.729418] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.376Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d91a5a0b0f0ef55cb927b31","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d91a5a0b0f0ef55cb927b31: start","job_status":"start","queue_duration_s":0.671872,"scheduling_latency_s":0.67189}1516gitlab # [ 299.742451] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.391Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d91a5a0b0f0ef55cb927b31","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d91a5a0b0f0ef55cb927b31: done: 0.014265 sec","job_status":"done","queue_duration_s":0.671872,"scheduling_latency_s":0.67189,"redis_calls":13,"redis_duration_s":0.001605,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000587,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001018,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009854,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014265,"completed_at":"2026-08-20T05:58:04.390Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1517gitlab # [ 299.783580] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.392Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff8f3772a19b6383205ff144","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff8f3772a19b6383205ff144: start","job_status":"start","queue_duration_s":0.68734,"scheduling_latency_s":0.687359}1518gitlab # [ 299.796877] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.406Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff8f3772a19b6383205ff144","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff8f3772a19b6383205ff144: done: 0.014147 sec","job_status":"done","queue_duration_s":0.68734,"scheduling_latency_s":0.687359,"redis_calls":13,"redis_duration_s":0.001567,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001036,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009703,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014147,"completed_at":"2026-08-20T05:58:04.406Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1519gitlab # [ 299.839760] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.407Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f7b0f472c6da3cc26eb1fd3","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f7b0f472c6da3cc26eb1fd3: start","job_status":"start","queue_duration_s":0.702806,"scheduling_latency_s":0.702825}1520gitlab # [ 299.877712] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.423Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f7b0f472c6da3cc26eb1fd3","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f7b0f472c6da3cc26eb1fd3: done: 0.015392 sec","job_status":"done","queue_duration_s":0.702806,"scheduling_latency_s":0.702825,"redis_calls":13,"redis_duration_s":0.001843,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000614,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001229,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010696,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015392,"completed_at":"2026-08-20T05:58:04.423Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1521gitlab # [ 299.947020] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.424Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"194d31f23de208ce1d9c6773","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-194d31f23de208ce1d9c6773: start","job_status":"start","queue_duration_s":0.719366,"scheduling_latency_s":0.719384}1522gitlab # [ 299.961654] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.439Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"194d31f23de208ce1d9c6773","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-194d31f23de208ce1d9c6773: done: 0.014957 sec","job_status":"done","queue_duration_s":0.719366,"scheduling_latency_s":0.719384,"redis_calls":13,"redis_duration_s":0.00166,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000554,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001106,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010306,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014957,"completed_at":"2026-08-20T05:58:04.439Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1523gitlab # [ 300.002847] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.440Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2fed8f3cf3f05b6e9db54dc3","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2fed8f3cf3f05b6e9db54dc3: start","job_status":"start","queue_duration_s":0.73574,"scheduling_latency_s":0.73576}1524gitlab # [ 300.015606] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.455Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2fed8f3cf3f05b6e9db54dc3","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2fed8f3cf3f05b6e9db54dc3: done: 0.014793 sec","job_status":"done","queue_duration_s":0.73574,"scheduling_latency_s":0.73576,"redis_calls":13,"redis_duration_s":0.0016950000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000629,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001066,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010234,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014793,"completed_at":"2026-08-20T05:58:04.455Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1525gitlab # [ 300.058600] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.456Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08a39b006862a70dbc615fa6","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08a39b006862a70dbc615fa6: start","job_status":"start","queue_duration_s":0.751894,"scheduling_latency_s":0.751914}1526gitlab # [ 300.071738] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.471Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08a39b006862a70dbc615fa6","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08a39b006862a70dbc615fa6: done: 0.014645 sec","job_status":"done","queue_duration_s":0.751894,"scheduling_latency_s":0.751914,"redis_calls":13,"redis_duration_s":0.0017029999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000619,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001084,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010037,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014645,"completed_at":"2026-08-20T05:58:04.471Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1527gitlab # [ 300.113233] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.522Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e86ae3fe0f76c6905351ac2a","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e86ae3fe0f76c6905351ac2a: start","job_status":"start","queue_duration_s":0.817304,"scheduling_latency_s":0.817332}1528gitlab # [ 300.126217] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.539Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e86ae3fe0f76c6905351ac2a","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e86ae3fe0f76c6905351ac2a: done: 0.017159 sec","job_status":"done","queue_duration_s":0.817304,"scheduling_latency_s":0.817332,"redis_calls":13,"redis_duration_s":0.001988,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000775,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001213,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011723,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017159,"completed_at":"2026-08-20T05:58:04.539Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1529gitlab # [ 300.166906] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.540Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"89ff7dbecdb98547cf86e61d","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-89ff7dbecdb98547cf86e61d: start","job_status":"start","queue_duration_s":0.835779,"scheduling_latency_s":0.8358}1530gitlab # [ 300.179976] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.557Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"89ff7dbecdb98547cf86e61d","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-89ff7dbecdb98547cf86e61d: done: 0.017001 sec","job_status":"done","queue_duration_s":0.835779,"scheduling_latency_s":0.8358,"redis_calls":13,"redis_duration_s":0.0018279999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000623,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001205,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012091,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017001,"completed_at":"2026-08-20T05:58:04.557Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1531gitlab # [ 300.221337] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.558Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bd945ab762b4988fb7da337b","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bd945ab762b4988fb7da337b: start","job_status":"start","queue_duration_s":0.853988,"scheduling_latency_s":0.854007}1532gitlab # [ 300.234277] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.574Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bd945ab762b4988fb7da337b","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bd945ab762b4988fb7da337b: done: 0.015137 sec","job_status":"done","queue_duration_s":0.853988,"scheduling_latency_s":0.854007,"redis_calls":13,"redis_duration_s":0.001537,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000596,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000941,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010558,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015137,"completed_at":"2026-08-20T05:58:04.573Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1533gitlab # [ 300.278772] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.575Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd9e7e5dfef780afeaa6aaa3","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd9e7e5dfef780afeaa6aaa3: start","job_status":"start","queue_duration_s":0.870273,"scheduling_latency_s":0.870291}1534gitlab # [ 300.316692] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.590Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd9e7e5dfef780afeaa6aaa3","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd9e7e5dfef780afeaa6aaa3: done: 0.015289 sec","job_status":"done","queue_duration_s":0.870273,"scheduling_latency_s":0.870291,"redis_calls":13,"redis_duration_s":0.001522,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000542,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00098,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009747,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015289,"completed_at":"2026-08-20T05:58:04.590Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1535gitlab # [ 300.388095] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.591Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"38340a94aa7e7561257401a2","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-38340a94aa7e7561257401a2: start","job_status":"start","queue_duration_s":0.886706,"scheduling_latency_s":0.886725}1536gitlab # [ 300.402623] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.608Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"38340a94aa7e7561257401a2","created_at":"2026-08-20T05:58:03.629Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-4c4a81763392405e","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"55e4408e7efc41c263fa557456b99e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.704Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-38340a94aa7e7561257401a2: done: 0.016806 sec","job_status":"done","queue_duration_s":0.886706,"scheduling_latency_s":0.886725,"redis_calls":13,"redis_duration_s":0.001549,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000556,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000993,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009708,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016806,"completed_at":"2026-08-20T05:58:04.608Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1537gitlab # [ 300.443385] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.609Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c2726c91c866642d6f208c15","created_at":"2026-08-20T05:58:03.762Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-6f657edf02f94a12","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6f6cf9bd251f1068a060e230476f1138","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.772Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c2726c91c866642d6f208c15: start","job_status":"start","queue_duration_s":0.837115,"scheduling_latency_s":0.837133}1538gitlab # [ 300.456460] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.622Z","message":"No existing merge request to be cleaned up."}1539gitlab # [ 300.459188] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.634Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c2726c91c866642d6f208c15","created_at":"2026-08-20T05:58:03.762Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-6f657edf02f94a12","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6f6cf9bd251f1068a060e230476f1138","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.772Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c2726c91c866642d6f208c15: done: 0.02442 sec","job_status":"done","queue_duration_s":0.837115,"scheduling_latency_s":0.837133,"redis_calls":10,"redis_duration_s":0.001586,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000677,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000909,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016836,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02442,"completed_at":"2026-08-20T05:58:04.633Z","load_balancing_strategy":"primary","db_duration_s":0.004455,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1540gitlab # [ 300.499817] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.635Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"be08260371ecbc86e694e3da","created_at":"2026-08-20T05:58:03.762Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-6f657edf02f94a12","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6f6cf9bd251f1068a060e230476f1138","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.772Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-be08260371ecbc86e694e3da: start","job_status":"start","queue_duration_s":0.862758,"scheduling_latency_s":0.862778}1541gitlab # [ 300.512559] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.648Z","message":"No existing merge request to be cleaned up."}1542gitlab # [ 300.514186] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.656Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"be08260371ecbc86e694e3da","created_at":"2026-08-20T05:58:03.762Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-6f657edf02f94a12","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6f6cf9bd251f1068a060e230476f1138","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.772Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-be08260371ecbc86e694e3da: done: 0.021713 sec","job_status":"done","queue_duration_s":0.862758,"scheduling_latency_s":0.862778,"redis_calls":10,"redis_duration_s":0.001532,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000622,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00091,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01536,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021713,"completed_at":"2026-08-20T05:58:04.656Z","load_balancing_strategy":"primary","db_duration_s":0.002746,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1543gitlab # [ 300.554076] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.658Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0e6d58357e9173a2990d735a","created_at":"2026-08-20T05:58:03.762Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-6f657edf02f94a12","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6f6cf9bd251f1068a060e230476f1138","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.772Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0e6d58357e9173a2990d735a: start","job_status":"start","queue_duration_s":0.885667,"scheduling_latency_s":0.885686}1544gitlab # [ 300.566692] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.670Z","message":"No existing merge request to be cleaned up."}1545gitlab # [ 300.568408] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.680Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0e6d58357e9173a2990d735a","created_at":"2026-08-20T05:58:03.762Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-6f657edf02f94a12","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6f6cf9bd251f1068a060e230476f1138","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.772Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0e6d58357e9173a2990d735a: done: 0.022603 sec","job_status":"done","queue_duration_s":0.885667,"scheduling_latency_s":0.885686,"redis_calls":10,"redis_duration_s":0.001549,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000707,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000842,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014599,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022603,"completed_at":"2026-08-20T05:58:04.680Z","load_balancing_strategy":"primary","db_duration_s":0.003063,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1546gitlab # [ 300.608159] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.682Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"d20682bd8e6e8c0d8c82f78d","created_at":"2026-08-20T05:58:03.762Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-6f657edf02f94a12","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6f6cf9bd251f1068a060e230476f1138","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.772Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-d20682bd8e6e8c0d8c82f78d: start","job_status":"start","queue_duration_s":0.909493,"scheduling_latency_s":0.909511}1547gitlab # [ 300.620730] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.694Z","message":"No existing merge request to be cleaned up."}1548gitlab # [ 300.622374] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:04.703Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"d20682bd8e6e8c0d8c82f78d","created_at":"2026-08-20T05:58:03.762Z","trace_propagation_headers":{"sentry-trace":"6284898bb57c480e9a35cb23d383b3f8-6f657edf02f94a12","baggage":"sentry-trace_id=6284898bb57c480e9a35cb23d383b3f8,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6f6cf9bd251f1068a060e230476f1138","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.772Z","job_size_bytes":2,"pid":2079,"sidekiq_tid":"m7oj","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-d20682bd8e6e8c0d8c82f78d: done: 0.021239 sec","job_status":"done","queue_duration_s":0.909493,"scheduling_latency_s":0.909511,"redis_calls":10,"redis_duration_s":0.001516,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000627,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000889,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014933,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021239,"completed_at":"2026-08-20T05:58:04.703Z","load_balancing_strategy":"primary","db_duration_s":0.002859,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1549gitlab # [ 309.235397] redis[792]: 10 changes in 300 seconds. Saving...1550gitlab # [ 309.242133] redis[792]: Background saving started by pid 33201551gitlab # [ 309.246183] redis[3320]: BGSAVE done, 442 keys saved, 0 keys skipped, 115666 bytes written.1552gitlab # [ 309.251394] redis[3320]: DB saved on disk1553gitlab # [ 309.253742] redis[3320]: Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB1554gitlab # [ 309.335657] redis[792]: Background saving terminated with success1555gitlab # [ 311.190619] postgres[863]: [863] LOG: checkpoint starting: time1556gitlab # [ 312.617118] gitaly[891]: time="2026-08-20T05:58:19.408Z" level=info msg="burden monitor stats" pid=8911557gitlab # [ 324.670561] postgres[3358]: [3358] ERROR: relation "table_without_models" does not exist1558gitlab # [ 324.671113] postgres[3358]: [3358] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1559gitlab # [ 330.535541] runuser[3018]: pam_unix(runuser:session): session closed for user gitlab1560gitlab # [ 330.537275] setup-gitlab-start[2996]: + systemctl restart gitlab-sidekiq.service1561gitlab # [ 330.577008] systemd[1]: Stopping gitlab-sidekiq.service...1562gitlab # [ 330.578608] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:37.369Z","message":"Shutting down"}1563gitlab # [ 330.580462] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:37.370Z","message":"Scheduler exiting..."}1564gitlab # [ 330.582301] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:37.371Z","message":"Terminating quiet threads for default capsule"}1565gitlab # [ 330.584516] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:37.371Z","message":"Scheduler exiting..."}1566gitlab # [ 331.081180] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:37.873Z","message":"Pausing to allow jobs to finish..."}1567gitlab # [ 333.586224] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:40.377Z","message":"Bye!"}1568gitlab # [ 333.628167] sidekiq-cluster[2079]: {"severity":"INFO","time":"2026-08-20T05:58:40.420Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":2079,"worker_id":"sidekiq_0","memwd_rss_bytes":930758656,"retry":0}1569gitlab # [ 334.779525] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1570gitlab # [ 334.779954] systemd[1]: Stopped gitlab-sidekiq.service.1571gitlab # [ 334.780240] systemd[1]: gitlab-sidekiq.service: Consumed 1min 50.509s CPU time over 3min 24.235s wall clock time, 939.5M memory peak, 4.5M read from disk.1572gitlab # [ 334.793837] systemd[1]: Started gitlab-sidekiq.service.1573gitlab # [ 334.797736] setup-gitlab-start[2996]: + mkdir -p /var/lib/secrets1574gitlab # [ 334.803512] setup-gitlab-start[2996]: + echo nixbot-test-token-of-20-chars1575gitlab # [ 334.806584] setup-gitlab-start[2996]: + chmod 644 /var/lib/secrets/gitlab-token1576gitlab # [ 334.809653] setup-gitlab-start[2996]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1577gitlab # [ 335.990994] gitaly[891]: time="2026-08-20T05:58:42.782Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW046XVJNV4Z86M93AFJ40 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:58:52.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:42.781" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1578gitlab # [ 336.000466] gitaly[891]: time="2026-08-20T05:58:42.782Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW046XVJNV4Z86M93AFJ40 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:58:52.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:42.781" grpc.time_ms=1.17 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1579gitlab # [ 336.220851] gitaly[891]: time="2026-08-20T05:58:43.013Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW046XVJNV4Z86M93AFJ40 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:58:53.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:43.012" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1580gitlab # [ 336.256447] gitaly[891]: time="2026-08-20T05:58:43.013Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW046XVJNV4Z86M93AFJ40 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:58:53.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:43.012" grpc.time_ms=0.563 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1581gitlab # [ 336.304169] gitaly[891]: time="2026-08-20T05:58:43.096Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW046XVJNV4Z86M93AFJ40 diskcache=56d7dfcc-e507-4677-930f-795de1e73ac2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T05:58:53.017" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:43.028" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1582gitlab # [ 336.334778] gitaly[891]: time="2026-08-20T05:58:43.096Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=39 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1440 command.oublock=32 command.real_time_ms=44 command.spawn_token_fork_ms=6 command.system_time_ms=36 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW046XVJNV4Z86M93AFJ40 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T05:58:53.017" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:43.028" grpc.time_ms=68.396 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1583gitlab # [ 336.365067] gitaly[891]: time="2026-08-20T05:58:43.117Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW046XVJNV4Z86M93AFJ40 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:58:53.105" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:43.115" pid=891 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1584gitlab # [ 336.384989] gitaly[891]: time="2026-08-20T05:58:43.117Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW046XVJNV4Z86M93AFJ40 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:58:53.105" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:43.115" grpc.time_ms=1.518 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1585gitlab # [ 336.405372] gitaly[891]: time="2026-08-20T05:58:43.138Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW046XVJNV4Z86M93AFJ40 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:58:53.114" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:43.125" grpc.time_ms=12.823 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1586gitlab # [ 336.473323] gitaly[891]: time="2026-08-20T05:58:43.265Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW046XVJNV4Z86M93AFJ40 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:58:53.254" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:43.265" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1587gitlab # [ 336.497127] gitaly[891]: time="2026-08-20T05:58:43.266Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW046XVJNV4Z86M93AFJ40 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:58:53.254" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:43.265" grpc.time_ms=0.681 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1588gitlab # [ 336.543356] gitaly[891]: time="2026-08-20T05:58:43.335Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW046XVJNV4Z86M93AFJ40 diskcache=83b2ef00-0ceb-4b04-aee4-7908532ec6dc grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T05:58:53.261" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:43.272" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1589gitlab # [ 336.566340] gitaly[891]: time="2026-08-20T05:58:43.336Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=37 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1439 command.oublock=32 command.real_time_ms=42 command.spawn_token_fork_ms=3 command.system_time_ms=27 command.user_time_ms=10 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW046XVJNV4Z86M93AFJ40 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T05:58:53.261" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:43.272" grpc.time_ms=63.675 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1590gitlab # [ 336.588737] gitaly[891]: time="2026-08-20T05:58:43.350Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW046XVJNV4Z86M93AFJ40 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:58:53.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:43.349" pid=891 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1591gitlab # [ 336.604820] gitaly[891]: time="2026-08-20T05:58:43.351Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW046XVJNV4Z86M93AFJ40 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:58:53.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:43.349" grpc.time_ms=1.477 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1592gitlab # [ 336.620021] gitaly[891]: time="2026-08-20T05:58:43.373Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW046XVJNV4Z86M93AFJ40 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:58:53.017" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:43.357" grpc.time_ms=15.693 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1593gitlab # [ 336.638170] gitaly[891]: time="2026-08-20T05:58:43.414Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW046XVJNV4Z86M93AFJ40 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:58:53.074" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:43.414" grpc.time_ms=0.229 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1594gitlab # [ 336.651583] gitaly[891]: time="2026-08-20T05:58:43.424Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW046XVJNV4Z86M93AFJ40 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T05:58:53.082" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:43.423" grpc.time_ms=0.596 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1595gitlab # [ 337.448449] gitaly[891]: time="2026-08-20T05:58:44.239Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW046XVJNV4Z86M93AFJ40 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:58:54.209" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:44.220" grpc.time_ms=18.907 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1596gitlab # [ 337.928063] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:44 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 30891597gitlab # [ 337.933271] setup-gitlab-start[2996]: + mkdir -p /tmp/test-flake1598gitlab # [ 337.937863] setup-gitlab-start[2996]: + cd /tmp/test-flake1599gitlab # [ 337.939599] setup-gitlab-start[2996]: + git init -b master1600gitlab # [ 337.977008] setup-gitlab-start[3477]: Initialized empty Git repository in /tmp/test-flake/.git/1601gitlab # [ 337.980498] setup-gitlab-start[2996]: + git config user.name test1602gitlab # [ 337.985212] setup-gitlab-start[2996]: + git config user.email test@example.com1603gitlab # [ 337.992593] setup-gitlab-start[2996]: + cat1604gitlab # [ 337.998185] setup-gitlab-start[2996]: + git add flake.nix1605gitlab # [ 338.007197] setup-gitlab-start[2996]: + git commit -m 'initial commit'1606gitlab # [ 338.030296] setup-gitlab-start[3482]: [master (root-commit) 033d758] initial commit1607gitlab # [ 338.034651] setup-gitlab-start[3482]: 1 file changed, 10 insertions(+)1608gitlab # [ 338.037688] setup-gitlab-start[3482]: create mode 100644 flake.nix1609gitlab # [ 338.040424] setup-gitlab-start[2996]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1610gitlab # [ 338.045999] setup-gitlab-start[2996]: + git push -u origin master1611gitlab # [ 338.498519] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:45 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 4021612gitlab # [ 339.327555] gitaly[891]: time="2026-08-20T05:58:46.119Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=8 component=gitaly.StreamServerInterceptor correlation_id=01M0EW07SCA8ARXCG2JJN631MG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:58:46.104" grpc.time_ms=14.941 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1613gitlab # [ 339.343020] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:46 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 8291614gitlab # [ 339.830573] gitaly[891]: time="2026-08-20T05:58:46.622Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW08M1F3TR1VCD5ZDZX01C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:58:56.267" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:46.608" grpc.time_ms=14.544 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1615gitlab # [ 339.896648] gitaly[891]: time="2026-08-20T05:58:46.688Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW08M1F3TR1VCD5ZDZX01C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-20T05:59:16.070" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-20T05:58:46.670" grpc.time_ms=17.723 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1616gitlab # [ 339.934369] gitaly[891]: time="2026-08-20T05:58:46.726Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M0EW08M1F3TR1VCD5ZDZX01C duration_ms=236ns method=POST pid=891 status=200 url="http://unix/api/v4/internal/allowed"1617gitlab # [ 339.982351] gitaly[891]: time="2026-08-20T05:58:46.774Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M0EW08M1F3TR1VCD5ZDZX01C duration_ms=46ns method=POST pid=891 status=200 url="http://unix/api/v4/internal/pre_receive"1618gitlab # [ 339.991324] gitaly[891]: time="2026-08-20T05:58:46.775Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW08M1F3TR1VCD5ZDZX01C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5316 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:58:46.488" grpc.time_ms=286.767 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1619gitlab # [ 340.020766] sidekiq-cluster[3425]: {"severity":"INFO","time":"2026-08-20T05:58:46.757Z","message":"Starting cluster with 1 processes"}1620gitlab # [ 340.031106] gitaly[891]: time="2026-08-20T05:58:46.823Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW08M1F3TR1VCD5ZDZX01C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:58:46.819" grpc.time_ms=3.284 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1621gitlab # [ 340.073579] gitaly[891]: time="2026-08-20T05:58:46.865Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW08M1F3TR1VCD5ZDZX01C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:58:46.863" grpc.time_ms=1.851 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1622gitlab # [ 340.118353] gitaly[891]: time="2026-08-20T05:58:46.910Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW08M1F3TR1VCD5ZDZX01C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4787 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:58:46.909" grpc.time_ms=0.727 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1623gitlab # [ 340.244463] gitaly[891]: time="2026-08-20T05:58:47.036Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW08M1F3TR1VCD5ZDZX01C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:58:57.008" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:47.018" grpc.time_ms=17.764 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1624gitlab # [ 340.292965] gitaly[891]: time="2026-08-20T05:58:47.085Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=28 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1435 command.oublock=0 command.real_time_ms=33 command.spawn_token_fork_ms=4 command.system_time_ms=22 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW08M1F3TR1VCD5ZDZX01C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-20T05:58:57.035" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:58:47.046" grpc.time_ms=38.421 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1625gitlab # [ 340.330051] gitaly[891]: time="2026-08-20T05:58:47.099Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M0EW08M1F3TR1VCD5ZDZX01C duration_ms=150ns method=POST pid=891 status=200 url="http://unix/api/v4/internal/post_receive"1626gitlab # [ 340.337168] gitaly[891]: time="2026-08-20T05:58:47.099Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW08M1F3TR1VCD5ZDZX01C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4810 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:58:46.947" grpc.time_ms=152.705 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1627gitlab # [ 340.359793] gitaly[891]: time="2026-08-20T05:58:47.118Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M0EW08M1F3TR1VCD5ZDZX01C diskcache=3a2b3627-5759-47d3-a885-2c3d818bcfbb grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:58:46.357" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1628gitlab # [ 340.377307] gitlab-workhorse[818]: time="2026-08-20T05:58:47Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521629gitlab # [ 340.379918] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:47 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 9741630gitlab # [ 340.383116] systemd[1]: Finished setup-gitlab.service.1631gitlab # [ 340.384293] setup-gitlab-start[3486]: To http://gitlab/root/test-flake.git1632gitlab # [ 340.385499] setup-gitlab-start[3486]: * [new branch] master -> master1633gitlab # [ 340.386719] setup-gitlab-start[3486]: branch 'master' set up to track 'origin/master'.1634gitlab # [ 340.388114] gitaly[891]: time="2026-08-20T05:58:47.118Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=304 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=847872 command.minflt=13485 command.oublock=32 command.real_time_ms=751 command.spawn_token_fork_ms=2 command.system_time_ms=176 command.user_time_ms=128 component=gitaly.StreamServerInterceptor correlation_id=01M0EW08M1F3TR1VCD5ZDZX01C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=686 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:58:46.357" grpc.time_ms=760.812 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1635gitlab # [ 340.404518] systemd[1]: Starting nixbot CI service...1636gitlab: (finished: waiting for unit setup-gitlab.service, in 341.30 seconds)1637gitlab: waiting for unit nixbot.service1638gitlab # [ 341.806946] nixbot[3574]: {"ts": "2026-08-20T05:58:48.598Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1639gitlab # [ 341.831378] nixbot[3574]: {"ts": "2026-08-20T05:58:48.623Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1640gitlab # [ 341.848842] nixbot[3574]: {"ts": "2026-08-20T05:58:48.641Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1641gitlab # [ 341.855465] nixbot[3574]: {"ts": "2026-08-20T05:58:48.645Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1642gitlab # [ 341.862369] nixbot[3574]: {"ts": "2026-08-20T05:58:48.649Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1643gitlab # [ 341.868768] nixbot[3574]: {"ts": "2026-08-20T05:58:48.655Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1644gitlab # [ 341.875177] nixbot[3574]: {"ts": "2026-08-20T05:58:48.660Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1645gitlab # [ 341.881857] nixbot[3574]: {"ts": "2026-08-20T05:58:48.662Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1646gitlab # [ 341.888379] nixbot[3574]: {"ts": "2026-08-20T05:58:48.668Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1647gitlab # [ 341.894946] nixbot[3574]: {"ts": "2026-08-20T05:58:48.670Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1648gitlab # [ 341.901665] nixbot[3574]: {"ts": "2026-08-20T05:58:48.675Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1649gitlab # [ 341.912379] nixbot[3574]: {"ts": "2026-08-20T05:58:48.681Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1650gitlab # [ 341.918767] nixbot[3574]: {"ts": "2026-08-20T05:58:48.684Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1651gitlab # [ 341.926258] nixbot[3574]: {"ts": "2026-08-20T05:58:48.687Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1652gitlab # [ 341.932930] nixbot[3574]: {"ts": "2026-08-20T05:58:48.693Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1653gitlab # [ 341.938691] nixbot[3574]: {"ts": "2026-08-20T05:58:48.695Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1654gitlab # [ 341.943887] nixbot[3574]: {"ts": "2026-08-20T05:58:48.698Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1655gitlab # [ 341.949086] nixbot[3574]: {"ts": "2026-08-20T05:58:48.699Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1656gitlab # [ 341.954835] nixbot[3574]: {"ts": "2026-08-20T05:58:48.704Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1657gitlab # [ 341.962979] nixbot[3574]: {"ts": "2026-08-20T05:58:48.706Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1658gitlab # [ 341.970365] nixbot[3574]: {"ts": "2026-08-20T05:58:48.707Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1659gitlab # [ 341.974469] nixbot[3574]: {"ts": "2026-08-20T05:58:48.713Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1660gitlab # [ 341.978642] nixbot[3574]: {"ts": "2026-08-20T05:58:48.715Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1661gitlab # [ 341.982858] nixbot[3574]: {"ts": "2026-08-20T05:58:48.716Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1662gitlab # [ 341.987047] nixbot[3574]: {"ts": "2026-08-20T05:58:48.719Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1663gitlab # [ 342.335298] nixbot[3574]: INFO: Started server process [3574]1664gitlab # [ 342.338497] nixbot[3574]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1665gitlab # [ 342.360765] nixbot[3574]: INFO: ::ffff:127.0.0.1:36698 - "GET /health HTTP/1.1" 200 OK1666gitlab # [ 342.367126] systemd[1]: Started nixbot CI service.1667gitlab # [ 342.369068] systemd[1]: Reached target Multi-User System.1668gitlab # [ 342.372042] systemd[1]: Startup finished in 809ms (kernel) + 4.450s (initrd) + 5min 37.112s (userspace) = 5min 42.371s.1669gitlab # [ 342.861636] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:49 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 4991670gitlab # [ 342.871063] nixbot[3574]: {"ts": "2026-08-20T05:58:49.657Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1671gitlab # [ 342.935306] nixbot[3574]: {"ts": "2026-08-20T05:58:49.727Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1672gitlab: (finished: waiting for unit nixbot.service, in 2.14 seconds)1673gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1674gitlab # [ 343.057693] nixbot[3574]: INFO: ::ffff:127.0.0.1:39784 - "GET /health HTTP/1.1" 200 OK1675gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.06 seconds)1676subtest: project discovered and webhook registered1677gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1678gitlab # [ 343.224757] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:50 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 1221679gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.17 seconds)1680gitlab # [ 343.289562] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:50 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 3151681gitlab # [ 343.292123] nixbot[3574]: {"ts": "2026-08-20T05:58:50.084Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1682gitlab # [ 343.295757] nixbot[3574]: {"ts": "2026-08-20T05:58:50.088Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1683gitlab # [ 344.193903] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:50 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 8911684gitlab # [ 344.195321] nixbot[3574]: {"ts": "2026-08-20T05:58:50.986Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1685gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1686gitlab # [ 344.432759] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:51 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 2251687gitlab # [ 344.435647] nixbot[3574]: {"ts": "2026-08-20T05:58:51.227Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1688gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.31 seconds)1689gitlab # [ 344.540535] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:51 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 2631690(finished: subtest: project discovered and webhook registered, in 1.48 seconds)1691subtest: push delivers the webhook1692gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1693gitlab # [ 344.565862] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:51 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 1071694gitlab # [ 344.576247] nixbot[3574]: {"ts": "2026-08-20T05:58:51.359Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1695gitlab # [ 344.671681] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:51 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 431696gitlab # [ 345.070672] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:51 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 4991697gitlab # [ 345.076141] nixbot[3574]: {"ts": "2026-08-20T05:58:51.865Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1698gitlab # [ 345.309915] gitaly[891]: time="2026-08-20T05:58:52.101Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=3 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0DTFNHPTEYWC0XS0GRCK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:58:52.088" grpc.time_ms=12.801 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1699gitlab # [ 345.329920] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:52 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 204 "" "git/2.55.0" 6321700gitlab # Enumerating objects: 5, done.1701gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1702gitlab # Delta compression using up to 4 threads1703gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1704gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 274 bytes | 68.00 KiB/s, done.1705gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1706gitlab # [ 345.379096] gitaly[891]: time="2026-08-20T05:58:52.171Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0E78G30Q40EFNADY1PPB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-08-20T05:59:22.055" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:58:52.157" grpc.time_ms=13.379 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1707gitlab # [ 345.434056] gitaly[891]: time="2026-08-20T05:58:52.226Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0E78G30Q40EFNADY1PPB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:59:22.124" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:58:52.225" grpc.time_ms=0.973 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1708gitlab # [ 345.465688] gitaly[891]: time="2026-08-20T05:58:52.257Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=8 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0E78G30Q40EFNADY1PPB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-20T05:59:02.225" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:58:52.236" grpc.time_ms=21.434 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1709gitlab # [ 345.525777] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:52 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 4371710gitlab # [ 345.540177] nixbot[3574]: {"ts": "2026-08-20T05:58:52.325Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1711gitlab # [ 345.676737] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:52 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1361712gitlab # [ 345.690574] nixbot[3574]: {"ts": "2026-08-20T05:58:52.478Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1713gitlab # [ 345.708661] nixbot[3574]: {"ts": "2026-08-20T05:58:52.495Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1714gitlab # [ 345.890531] gitaly[891]: time="2026-08-20T05:58:52.682Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=5 command.system_time_ms=16 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0EWQSN0Q7WSVJ136ZEQ6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=196 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:58:52.656" grpc.time_ms=26.255 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1715gitlab # [ 345.926249] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:52 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1161716gitlab # [ 346.071951] gitaly[891]: time="2026-08-20T05:58:52.862Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0F0EBXQ2QZKX09JQEZ96 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:58:52.851" pid=891 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1717gitlab # [ 346.104443] gitaly[891]: time="2026-08-20T05:58:52.863Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=5 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0F0EBXQ2QZKX09JQEZ96 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:58:52.851" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1718gitlab # [ 346.136667] gitlab-workhorse[818]: time="2026-08-20T05:58:52Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131719gitlab # [ 346.139945] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:52 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 1781720gitlab # [ 346.143364] gitaly[891]: time="2026-08-20T05:58:52.863Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=5 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0F0EBXQ2QZKX09JQEZ96 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:58:52.851" grpc.time_ms=12.266 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1721gitlab # [ 346.196922] gitaly[891]: time="2026-08-20T05:58:52.989Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0F635RFPQA3P1A3763CV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:58:52.970" pid=891 remote_ip="2001:db8:1::1" request_sha=eb20219ccb88b1a23daf7a58962fef61a369ef57 response_bytes=223 span.kind=server system=grpc1722gitlab # [ 346.219891] gitaly[891]: time="2026-08-20T05:58:52.989Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1138 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=1 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0F635RFPQA3P1A3763CV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:58:52.970" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1723gitlab # [ 346.244786] gitlab-workhorse[818]: time="2026-08-20T05:58:52Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2231724gitlab # [ 346.247598] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:52 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 1221725gitlab # [ 346.251043] gitaly[891]: time="2026-08-20T05:58:52.989Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1138 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=1 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0F635RFPQA3P1A3763CV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:58:52.970" grpc.time_ms=19.239 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1726gitlab # [ 346.348181] gitaly[891]: time="2026-08-20T05:58:53.139Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0FBE2C6Z7ZKTBVD76RZH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:58:53.121" grpc.time_ms=17.911 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1727gitlab # [ 346.382971] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:53 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1351728gitlab # [ 346.490373] gitaly[891]: time="2026-08-20T05:58:53.282Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0FFTJCF2CVM73HWQM5Q4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:58:53.268" pid=891 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1729gitlab # [ 346.501153] gitaly[891]: time="2026-08-20T05:58:53.282Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0FFTJCF2CVM73HWQM5Q4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:58:53.268" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1730gitlab # [ 346.517011] gitlab-workhorse[818]: time="2026-08-20T05:58:53Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671731gitlab # [ 346.518959] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:53 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1051732gitlab # [ 346.521098] gitaly[891]: time="2026-08-20T05:58:53.283Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0FFTJCF2CVM73HWQM5Q4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:58:53.268" grpc.time_ms=14.459 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1733gitlab # [ 346.626905] gitaly[891]: time="2026-08-20T05:58:53.419Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=5 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0FMTR375Q52PB2P5ZRTM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:58:53.403" grpc.time_ms=15.556 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1734gitlab # [ 346.648516] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:53 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 821735gitlab # [ 346.783734] gitaly[891]: time="2026-08-20T05:58:53.575Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=300 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=5 command.system_time_ms=0 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0EFSQRYSTTJAG1PZY60D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-20T05:59:23.464" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-20T05:58:53.565" grpc.time_ms=10.552 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1736gitlab # [ 346.809984] gitaly[891]: time="2026-08-20T05:58:53.593Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M0EW0EFSQRYSTTJAG1PZY60D duration_ms=102ns method=POST pid=891 status=200 url="http://unix/api/v4/internal/allowed"1737gitlab # [ 346.834353] gitaly[891]: time="2026-08-20T05:58:53.626Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M0EW0EFSQRYSTTJAG1PZY60D duration_ms=29ns method=POST pid=891 status=200 url="http://unix/api/v4/internal/pre_receive"1738gitlab # [ 346.842374] gitaly[891]: time="2026-08-20T05:58:53.627Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW0EFSQRYSTTJAG1PZY60D grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5316 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:58:53.489" grpc.time_ms=137.411 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1739gitlab # [ 346.885817] gitaly[891]: time="2026-08-20T05:58:53.678Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0FQGTST766NHEA21530D grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:58:53.648" pid=891 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1740gitlab # [ 346.904360] gitaly[891]: time="2026-08-20T05:58:53.678Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1102 command.oublock=0 command.real_time_ms=27 command.spawn_token_fork_ms=5 command.system_time_ms=8 command.user_time_ms=10 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0FQGTST766NHEA21530D grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:58:53.648" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1741gitlab # [ 346.925122] gitlab-workhorse[818]: time="2026-08-20T05:58:53Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091742gitlab # [ 346.927725] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:53 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 2561743gitlab # [ 346.930502] gitaly[891]: time="2026-08-20T05:58:53.678Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW0EFSQRYSTTJAG1PZY60D grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:58:53.678" grpc.time_ms=0.641 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1744gitlab # [ 346.944345] gitaly[891]: time="2026-08-20T05:58:53.680Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1102 command.oublock=0 command.real_time_ms=27 command.spawn_token_fork_ms=5 command.system_time_ms=8 command.user_time_ms=10 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0FQGTST766NHEA21530D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:58:53.648" grpc.time_ms=31.791 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1745gitlab # [ 346.961509] gitaly[891]: time="2026-08-20T05:58:53.717Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW0EFSQRYSTTJAG1PZY60D grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:58:53.716" grpc.time_ms=1.262 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1746gitlab # [ 346.972817] gitaly[891]: time="2026-08-20T05:58:53.750Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW0EFSQRYSTTJAG1PZY60D grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4787 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:58:53.749" grpc.time_ms=0.996 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1747gitlab # [ 347.046746] gitaly[891]: time="2026-08-20T05:58:53.839Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M0EW0EFSQRYSTTJAG1PZY60D duration_ms=57ns method=POST pid=891 status=200 url="http://unix/api/v4/internal/post_receive"1748gitlab # [ 347.054231] gitaly[891]: time="2026-08-20T05:58:53.839Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW0EFSQRYSTTJAG1PZY60D grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4810 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:58:53.780" grpc.time_ms=59.024 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1749gitlab # [ 347.065084] gitaly[891]: time="2026-08-20T05:58:53.850Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0G0WRPS4F5JTAZ2Z6KZ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:59:23.047" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:58:53.849" grpc.time_ms=0.855 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1750gitlab # To http://gitlab/root/test-flake.git1751gitlab # [ 347.078661] gitaly[891]: time="2026-08-20T05:58:53.860Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M0EW0EFSQRYSTTJAG1PZY60D diskcache=ca7a66d5-3b9d-42cd-a547-d2591084ce76 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:58:53.404" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1752gitlab # 033d758..1cdfdca [ 347.089607] gitlab-workhorse[818]: time="2026-08-20T05:58:53Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521753gitlab # master -> master[ 347.091698] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:53 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 17081754gitlab # 1755gitlab # [ 347.093942] gitaly[891]: time="2026-08-20T05:58:53.861Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=164 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=831488 command.minflt=13323 command.oublock=32 command.real_time_ms=443 command.spawn_token_fork_ms=7 command.system_time_ms=88 command.user_time_ms=76 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0EFSQRYSTTJAG1PZY60D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=606 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=58 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:58:53.404" grpc.time_ms=456.424 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1756gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 2.57 seconds)1757gitlab: must succeed: git -C /tmp/test-flake rev-parse master1758gitlab # [ 347.112196] gitaly[891]: time="2026-08-20T05:58:53.904Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=591 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0G0WRPS4F5JTAZ2Z6KZ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-20T05:59:23.092" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:58:53.892" grpc.time_ms=11.646 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1759gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.02 seconds)1760gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1761gitlab # [ 347.148375] gitaly[891]: time="2026-08-20T05:58:53.940Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0G0WRPS4F5JTAZ2Z6KZ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:59:03.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:58:53.928" grpc.time_ms=11.215 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1762gitlab # [ 347.172783] gitaly[891]: time="2026-08-20T05:58:53.965Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0G0WRPS4F5JTAZ2Z6KZ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:59:03.035" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:58:53.955" grpc.time_ms=9.534 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1763gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.09 seconds)1764gitlab # [ 347.224673] nixbot[3574]: INFO: ::ffff:127.0.0.1:39798 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1765gitlab # [ 347.306169] gitaly[891]: time="2026-08-20T05:58:54.098Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0G0WRPS4F5JTAZ2Z6KZ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T05:59:04.007" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:54.097" grpc.time_ms=0.39 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1766gitlab # [ 347.336362] gitaly[891]: time="2026-08-20T05:58:54.128Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0G0WRPS4F5JTAZ2Z6KZ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T05:59:04.023" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:58:54.114" grpc.time_ms=13.203 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1767gitlab # [ 347.407023] gitaly[891]: time="2026-08-20T05:58:54.198Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW0G0WRPS4F5JTAZ2Z6KZ3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:58:54.197" grpc.time_ms=0.844 pid=891 span.kind=server system=grpc1768gitlab # [ 347.447132] gitaly[891]: time="2026-08-20T05:58:54.239Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW0G0WRPS4F5JTAZ2Z6KZ3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4156 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:58:54.238" grpc.time_ms=0.816 pid=891 span.kind=server system=grpc1769gitlab # [ 347.469596] gitaly[891]: time="2026-08-20T05:58:54.252Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0G0WRPS4F5JTAZ2Z6KZ3 diskcache=4633df47-6fa6-45ef-800b-3d966ec7e2ab grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T05:59:04.042" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:54.134" pid=891 ref=refs/keep-around/033d7582398e9bef590efff8854214897015f02b remote_ip="2001:db8:1::1" revision=033d7582398e9bef590efff8854214897015f02b span.kind=server system=grpc username=root1770gitlab # [ 347.489616] gitaly[891]: time="2026-08-20T05:58:54.252Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=106 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5067 command.oublock=8 command.real_time_ms=109 command.spawn_token_fork_ms=2 command.system_time_ms=63 command.user_time_ms=43 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0G0WRPS4F5JTAZ2Z6KZ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T05:59:04.042" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:54.134" grpc.time_ms=118.214 pid=891 ref=refs/keep-around/033d7582398e9bef590efff8854214897015f02b remote_ip="2001:db8:1::1" revision=033d7582398e9bef590efff8854214897015f02b span.kind=server system=grpc username=root1771gitlab # [ 347.510008] gitaly[891]: time="2026-08-20T05:58:54.260Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0G0WRPS4F5JTAZ2Z6KZ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:59:24.058" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:58:54.258" grpc.time_ms=0.998 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1772gitlab # [ 347.807322] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:54 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/033d7582398e9bef590efff8854214897015f02b HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 8741773gitlab # [ 347.810677] nixbot[3574]: {"ts": "2026-08-20T05:58:54.601Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/033d7582398e9bef590efff8854214897015f02b \"HTTP/1.1 201 Created\""}1774gitlab # [ 347.826357] nixbot[3574]: {"ts": "2026-08-20T05:58:54.618Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-033d7582398e-0"}1775gitlab # [ 347.948541] systemd[1]: Started Nix Daemon.1776gitlab # [ 348.066666] nix-daemon[3796]: accepted connection from pid 3790, user nixbot1777gitlab # [ 348.197590] nix-daemon[3796]: accepted connection from pid 3803, user nixbot1778gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1779gitlab # [ 348.222268] nixbot[3574]: {"ts": "2026-08-20T05:58:55.014Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-033d7582398e-0", "argv0": "bwrap"}1780gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)1781gitlab # [ 348.282815] nixbot[3574]: INFO: ::ffff:127.0.0.1:39812 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1782gitlab # [ 348.438631] nix-daemon[3796]: accepted connection from pid 3816, user nixbot1783gitlab # [ 348.521476] nix-daemon[3796]: accepted connection from pid 3826, user nixbot1784gitlab # [ 348.548289] nix-daemon[3796]: accepted connection from pid 3816, user nixbot1785gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1786gitlab # [ 349.336858] nixbot[3574]: INFO: ::ffff:127.0.0.1:39828 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1787gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)1788gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1789gitlab # [ 350.395315] nixbot[3574]: INFO: ::ffff:127.0.0.1:39844 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1790gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)1791gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1792gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.05 seconds)1793gitlab # [ 351.453228] nixbot[3574]: INFO: ::ffff:127.0.0.1:41184 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1794gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1795gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.05 seconds)1796gitlab # [ 352.507573] nixbot[3574]: INFO: ::ffff:127.0.0.1:41194 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1797gitlab # [ 352.920680] gitaly[891]: time="2026-08-20T05:58:59.712Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0NR1SH6EEGXW0DADN3GF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:59:29.109" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:58:59.710" grpc.time_ms=1.232 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1798gitlab # [ 353.150634] gitaly[891]: time="2026-08-20T05:58:59.942Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0NR1SH6EEGXW0DADN3GF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:59:09.153" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:58:59.924" grpc.time_ms=18.43 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1799gitlab # [ 353.319530] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:05:59:00 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/033d7582398e9bef590efff8854214897015f02b HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 5241800gitlab # [ 353.329195] nixbot[3574]: {"ts": "2026-08-20T05:59:00.112Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/033d7582398e9bef590efff8854214897015f02b \"HTTP/1.1 201 Created\""}1801gitlab # [ 353.402092] gitaly[891]: time="2026-08-20T05:59:00.194Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0P8SZAV8RHXK3NN5TCBP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:59:30.092" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:59:00.192" grpc.time_ms=1.106 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1802gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1803gitlab # [ 353.481396] gitaly[891]: time="2026-08-20T05:59:00.273Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0P8SZAV8RHXK3NN5TCBP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:59:10.244" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:59:00.254" grpc.time_ms=18.324 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1804gitlab # [ 353.553974] nixbot[3574]: INFO: ::ffff:127.0.0.1:41206 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1805gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.05 seconds)1806gitlab # [ 353.606304] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:05:59:00 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/033d7582398e9bef590efff8854214897015f02b HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2761807gitlab # [ 353.614610] nixbot[3574]: {"ts": "2026-08-20T05:59:00.400Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/033d7582398e9bef590efff8854214897015f02b \"HTTP/1.1 201 Created\""}1808gitlab # [ 353.748378] gitaly[891]: time="2026-08-20T05:59:00.540Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0PJ7GZP2EFBWE0SNJKNK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:59:30.338" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:59:00.538" grpc.time_ms=1.365 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1809gitlab # [ 353.839196] gitaly[891]: time="2026-08-20T05:59:00.631Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0PJ7GZP2EFBWE0SNJKNK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:59:10.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:59:00.611" grpc.time_ms=19.567 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1810gitlab # [ 353.953210] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:05:59:00 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/033d7582398e9bef590efff8854214897015f02b HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 3211811gitlab # [ 353.961355] nixbot[3574]: {"ts": "2026-08-20T05:59:00.747Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/033d7582398e9bef590efff8854214897015f02b \"HTTP/1.1 201 Created\""}1812gitlab # [ 354.116466] nix-daemon[3796]: accepted connection from pid 3865, user nixbot1813gitlab # [ 354.327565] gitaly[891]: time="2026-08-20T05:59:01.118Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0Q42MMP0AA92A8FHG77D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:59:01.099" grpc.time_ms=18.846 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1814gitlab # [ 354.366749] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:05:59:01 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1241815gitlab # [ 354.447192] gitaly[891]: time="2026-08-20T05:59:01.239Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0Q82QA0ASDREH08RVS6F grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:59:01.219" pid=891 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1816gitlab # [ 354.478768] gitaly[891]: time="2026-08-20T05:59:01.239Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0Q82QA0ASDREH08RVS6F grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:59:01.219" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1817gitlab # [ 354.507644] gitlab-workhorse[818]: time="2026-08-20T05:59:01Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671818gitlab # [ 354.510962] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:05:59:01 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1481819gitlab # [ 354.514147] gitaly[891]: time="2026-08-20T05:59:01.240Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0Q82QA0ASDREH08RVS6F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:59:01.219" grpc.time_ms=20.592 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1820gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1821gitlab # [ 354.622597] nixbot[3574]: INFO: ::ffff:127.0.0.1:41222 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1822gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.07 seconds)1823gitlab # [ 354.649478] gitaly[891]: time="2026-08-20T05:59:01.441Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0QCV80WXYSVNC2J9QGKC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:59:01.404" pid=891 remote_ip="2001:db8:1::1" request_sha=81d7d24f529d464622b2813f119b5f928b68ed44 response_bytes=337 span.kind=server system=grpc1824gitlab # [ 354.675762] gitaly[891]: time="2026-08-20T05:59:01.442Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=28 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1130 command.oublock=0 command.real_time_ms=32 command.spawn_token_fork_ms=2 command.system_time_ms=24 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0QCV80WXYSVNC2J9QGKC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:59:01.404" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1825gitlab # [ 354.702565] gitlab-workhorse[818]: time="2026-08-20T05:59:01Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3371826gitlab # [ 354.705585] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:05:59:01 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 337 "" "git/2.55.0" 1671827gitlab # [ 354.708465] gitaly[891]: time="2026-08-20T05:59:01.442Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=28 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1130 command.oublock=0 command.real_time_ms=32 command.spawn_token_fork_ms=2 command.system_time_ms=24 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0QCV80WXYSVNC2J9QGKC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:59:01.404" grpc.time_ms=37.659 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1828gitlab # [ 354.830875] nix-daemon[3796]: accepted connection from pid 3898, user nixbot1829gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1830gitlab # [ 355.684332] nixbot[3574]: INFO: ::ffff:127.0.0.1:41238 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1831gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)1832gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1833gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.05 seconds)1834gitlab # [ 356.740929] nixbot[3574]: INFO: ::ffff:127.0.0.1:41252 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1835gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1836gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)1837gitlab # [ 357.796483] nixbot[3574]: INFO: ::ffff:127.0.0.1:41264 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1838gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1839gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.05 seconds)1840gitlab # [ 358.851126] nixbot[3574]: INFO: ::ffff:127.0.0.1:41274 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1841gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1842gitlab # [ 359.906037] nixbot[3574]: INFO: ::ffff:127.0.0.1:41290 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1843gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)1844gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1845gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.05 seconds)1846gitlab # [ 360.962221] nixbot[3574]: INFO: ::ffff:127.0.0.1:46538 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1847gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1848gitlab # [ 362.016802] nixbot[3574]: INFO: ::ffff:127.0.0.1:46544 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1849gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)1850gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1851gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.05 seconds)1852gitlab # [ 363.072764] nixbot[3574]: INFO: ::ffff:127.0.0.1:46548 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1853gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1854gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.05 seconds)1855gitlab # [ 364.126641] nixbot[3574]: INFO: ::ffff:127.0.0.1:46552 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1856gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1857gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)1858gitlab # [ 365.182958] nixbot[3574]: INFO: ::ffff:127.0.0.1:46562 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1859gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1860gitlab # [ 366.241418] nixbot[3574]: INFO: ::ffff:127.0.0.1:46568 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1861gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)1862gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1863gitlab # [ 367.297936] nixbot[3574]: INFO: ::ffff:127.0.0.1:46584 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1864gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)1865gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1866gitlab # [ 368.356851] nixbot[3574]: INFO: ::ffff:127.0.0.1:46590 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1867gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)1868gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1869gitlab # [ 369.415079] nixbot[3574]: INFO: ::ffff:127.0.0.1:46600 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1870gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)1871gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1872gitlab # [ 370.471129] nixbot[3574]: INFO: ::ffff:127.0.0.1:46614 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1873gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)1874gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1875gitlab # [ 371.530092] nixbot[3574]: INFO: ::ffff:127.0.0.1:53544 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1876gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)1877gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1878gitlab # [ 372.587135] nixbot[3574]: INFO: ::ffff:127.0.0.1:53560 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1879gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)1880gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1881gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.05 seconds)1882gitlab # [ 373.643990] nixbot[3574]: INFO: ::ffff:127.0.0.1:53570 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1883gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1884gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.05 seconds)1885gitlab # [ 374.698783] nixbot[3574]: INFO: ::ffff:127.0.0.1:53572 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1886gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1887gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.05 seconds)1888gitlab # [ 375.752772] nixbot[3574]: INFO: ::ffff:127.0.0.1:53576 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1889gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1890gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.05 seconds)1891gitlab # [ 376.808188] nixbot[3574]: INFO: ::ffff:127.0.0.1:53590 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1892gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1893gitlab # [ 377.862910] nixbot[3574]: INFO: ::ffff:127.0.0.1:53592 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1894gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)1895gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1896gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)1897gitlab # [ 378.920528] nixbot[3574]: INFO: ::ffff:127.0.0.1:53598 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1898gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1899gitlab # [ 379.976087] nixbot[3574]: INFO: ::ffff:127.0.0.1:53610 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1900gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)1901gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1902gitlab # [ 381.031100] nixbot[3574]: INFO: ::ffff:127.0.0.1:38410 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1903gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.05 seconds)1904gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1905gitlab # [ 382.086843] nixbot[3574]: INFO: ::ffff:127.0.0.1:38420 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1906gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)1907gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1908gitlab # [ 383.143147] nixbot[3574]: INFO: ::ffff:127.0.0.1:38426 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1909gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)1910gitlab # [ 384.137780] sidekiq-cluster[3530]: 2026-08-20T05:59:30.928Z pid=3530 tid=yn6 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>3530, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>432041984}1911gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1912gitlab # [ 384.200713] nixbot[3574]: INFO: ::ffff:127.0.0.1:38442 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1913gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)1914gitlab # [ 384.460454] sidekiq-cluster[3530]: W, [2026-08-20T05:59:31.252601 #3530] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1915gitlab # [ 384.520647] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T05:59:31.312Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1916gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1917gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.05 seconds)1918gitlab # [ 385.257579] nixbot[3574]: INFO: ::ffff:127.0.0.1:38446 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1919gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1920gitlab # [ 386.312685] nixbot[3574]: INFO: ::ffff:127.0.0.1:38462 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1921gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)1922gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1923gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.05 seconds)1924gitlab # [ 387.369739] nixbot[3574]: INFO: ::ffff:127.0.0.1:38478 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1925gitlab # [ 388.279628] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T05:59:35.070Z","message":"GitLab reliable fetch activated!"}1926gitlab # [ 388.280083] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T05:59:35.071Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1927gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1928gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.05 seconds)1929gitlab # [ 388.418011] nixbot[3574]: INFO: ::ffff:127.0.0.1:38482 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1930gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1931gitlab # [ 389.473973] nixbot[3574]: INFO: ::ffff:127.0.0.1:38484 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1932gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)1933gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1934gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)1935gitlab # [ 390.532859] nixbot[3574]: INFO: ::ffff:127.0.0.1:38490 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1936gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1937gitlab # [ 391.588355] nixbot[3574]: INFO: ::ffff:127.0.0.1:34032 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1938gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)1939gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1940gitlab # [ 392.645026] nixbot[3574]: INFO: ::ffff:127.0.0.1:34046 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1941gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)1942gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1943gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.05 seconds)1944gitlab # [ 393.701221] nixbot[3574]: INFO: ::ffff:127.0.0.1:34056 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1945gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1946gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.05 seconds)1947gitlab # [ 394.754902] nixbot[3574]: INFO: ::ffff:127.0.0.1:34062 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1948gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1949gitlab # [ 395.810122] nixbot[3574]: INFO: ::ffff:127.0.0.1:34066 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1950gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)1951gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1952gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.05 seconds)1953gitlab # [ 396.867785] nixbot[3574]: INFO: ::ffff:127.0.0.1:34082 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1954gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1955gitlab # [ 397.922967] nixbot[3574]: INFO: ::ffff:127.0.0.1:34092 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1956gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)1957gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1958gitlab # [ 398.980750] nixbot[3574]: INFO: ::ffff:127.0.0.1:34094 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1959gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)1960gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1961gitlab # [ 400.037311] nixbot[3574]: INFO: ::ffff:127.0.0.1:34110 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1962gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)1963gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1964gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.05 seconds)1965gitlab # [ 401.094102] nixbot[3574]: INFO: ::ffff:127.0.0.1:57672 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1966gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1967gitlab # [ 402.148121] nixbot[3574]: INFO: ::ffff:127.0.0.1:57688 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1968gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)1969gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1970gitlab # [ 403.204996] nixbot[3574]: INFO: ::ffff:127.0.0.1:57694 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1971gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)1972gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1973gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.05 seconds)1974gitlab # [ 404.261438] nixbot[3574]: INFO: ::ffff:127.0.0.1:57706 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1975gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1976gitlab # [ 405.316336] nixbot[3574]: INFO: ::ffff:127.0.0.1:57712 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1977gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)1978gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1979gitlab # [ 406.371317] nixbot[3574]: INFO: ::ffff:127.0.0.1:57714 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1980gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)1981gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1982gitlab # [ 407.429090] nixbot[3574]: INFO: ::ffff:127.0.0.1:57724 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1983gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)1984gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1985gitlab # [ 408.484955] nixbot[3574]: INFO: ::ffff:127.0.0.1:57728 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1986gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)1987gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1988gitlab # [ 409.540217] nixbot[3574]: INFO: ::ffff:127.0.0.1:57732 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1989gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.05 seconds)1990gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1991gitlab # [ 410.595557] nixbot[3574]: INFO: ::ffff:127.0.0.1:57734 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1992gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)1993gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1994gitlab # [ 411.651822] nixbot[3574]: INFO: ::ffff:127.0.0.1:55598 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1995gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)1996gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'1997gitlab # [ 412.708707] nixbot[3574]: INFO: ::ffff:127.0.0.1:55602 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK1998gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)1999gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'2000gitlab # [ 413.764968] nixbot[3574]: INFO: ::ffff:127.0.0.1:55604 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK2001gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)2002gitlab # [ 413.855479] systemd[1]: Starting Logrotate Service...2003gitlab # [ 413.991225] systemd[1]: logrotate.service: Deactivated successfully.2004gitlab # [ 413.994306] systemd[1]: Finished Logrotate Service.2005gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'2006gitlab # [ 414.822923] nixbot[3574]: INFO: ::ffff:127.0.0.1:55608 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK2007gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)2008gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'2009gitlab # [ 415.880844] nixbot[3574]: INFO: ::ffff:127.0.0.1:55614 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK2010gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)2011gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'2012gitlab # [ 416.936736] nixbot[3574]: INFO: ::ffff:127.0.0.1:55626 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK2013gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)2014gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'2015gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.05 seconds)2016gitlab # [ 417.993719] nixbot[3574]: INFO: ::ffff:127.0.0.1:55636 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK2017gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'2018gitlab # [ 419.046831] nixbot[3574]: INFO: ::ffff:127.0.0.1:55644 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK2019gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.05 seconds)2020gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'2021gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.05 seconds)2022gitlab # [ 420.100741] nixbot[3574]: INFO: ::ffff:127.0.0.1:55658 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK2023gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'2024gitlab # [ 421.153515] nixbot[3574]: INFO: ::ffff:127.0.0.1:38596 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK2025gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)2026gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'2027gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.05 seconds)2028gitlab # [ 422.209346] nixbot[3574]: INFO: ::ffff:127.0.0.1:38612 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK2029gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'2030gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.05 seconds)2031gitlab # [ 423.264993] nixbot[3574]: INFO: ::ffff:127.0.0.1:38624 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK2032gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'2033gitlab # [ 424.319013] nixbot[3574]: INFO: ::ffff:127.0.0.1:38640 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK2034gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)2035gitlab # [ 425.292830] postgres[4123]: [4123] ERROR: relation "table_without_models" does not exist2036gitlab # [ 425.293183] postgres[4123]: [4123] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')2037gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'2038gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.05 seconds)2039gitlab # [ 425.375644] nixbot[3574]: INFO: ::ffff:127.0.0.1:38646 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK2040gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'2041gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.05 seconds)2042gitlab # [ 426.430647] nixbot[3574]: INFO: ::ffff:127.0.0.1:38662 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK2043gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'2044gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.05 seconds)2045gitlab # [ 427.485654] nixbot[3574]: INFO: ::ffff:127.0.0.1:38676 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK2046gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'2047gitlab # [ 428.543249] nixbot[3574]: INFO: ::ffff:127.0.0.1:38682 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK2048gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)2049gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'2050gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.05 seconds)2051gitlab # [ 429.601184] nixbot[3574]: INFO: ::ffff:127.0.0.1:38688 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK2052gitlab # [ 430.220961] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:17.012Z","message":"Booted Rails 7.2.3.1 application in production environment"}2053gitlab # [ 430.227863] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:17.019Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}2054gitlab # [ 430.232304] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:17.019Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}2055gitlab # [ 430.234126] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:17.019Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}2056gitlab # [ 430.236210] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:17.023Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2057gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'2058gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)2059gitlab # [ 430.661377] nixbot[3574]: INFO: ::ffff:127.0.0.1:38696 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK2060gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'2061gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.09 seconds)2062gitlab # [ 431.746997] nixbot[3574]: INFO: ::ffff:127.0.0.1:59836 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK2063gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'2064gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)2065gitlab # [ 432.807202] nixbot[3574]: INFO: ::ffff:127.0.0.1:59852 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK2066gitlab # [ 432.993450] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:19.783Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"18b4388fab81b7e7dad2e4ea","created_at":"2026-08-20T05:58:43.159Z","trace_propagation_headers":{"sentry-trace":"3d5d93a5a0a9408380f02a3200731179-5798ec49132f41d6","baggage":"sentry-trace_id=3d5d93a5a0a9408380f02a3200731179,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW046XVJNV4Z86M93AFJ40","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:43.227Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-18b4388fab81b7e7dad2e4ea: start","job_status":"start","queue_duration_s":96.556724,"scheduling_latency_s":96.556824}2067gitlab # [ 433.394454] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:20.185Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"18b4388fab81b7e7dad2e4ea","created_at":"2026-08-20T05:58:43.159Z","trace_propagation_headers":{"sentry-trace":"3d5d93a5a0a9408380f02a3200731179-5798ec49132f41d6","baggage":"sentry-trace_id=3d5d93a5a0a9408380f02a3200731179,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW046XVJNV4Z86M93AFJ40","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:43.227Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-18b4388fab81b7e7dad2e4ea: done: 0.402234 sec","job_status":"done","queue_duration_s":96.556724,"scheduling_latency_s":96.556824,"redis_calls":23,"redis_duration_s":0.010797,"redis_read_bytes":910,"redis_write_bytes":2540,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.005742,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002916,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002139,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.202951,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.20517456,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.402234,"completed_at":"2026-08-20T06:00:20.185Z","load_balancing_strategy":"primary","db_duration_s":0.114686,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2068gitlab # [ 433.502784] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:20.188Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"33db2ed497eb453b4f9a5a3e","created_at":"2026-08-20T05:58:43.248Z","trace_propagation_headers":{"sentry-trace":"3d5d93a5a0a9408380f02a3200731179-5798ec49132f41d6","baggage":"sentry-trace_id=3d5d93a5a0a9408380f02a3200731179,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW046XVJNV4Z86M93AFJ40","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:43.256Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-33db2ed497eb453b4f9a5a3e: start","job_status":"start","queue_duration_s":96.93222,"scheduling_latency_s":96.932263}2069gitlab # [ 433.597878] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:20.389Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"33db2ed497eb453b4f9a5a3e","created_at":"2026-08-20T05:58:43.248Z","trace_propagation_headers":{"sentry-trace":"3d5d93a5a0a9408380f02a3200731179-5798ec49132f41d6","baggage":"sentry-trace_id=3d5d93a5a0a9408380f02a3200731179,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW046XVJNV4Z86M93AFJ40","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:43.256Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-33db2ed497eb453b4f9a5a3e: done: 0.200149 sec","job_status":"done","queue_duration_s":96.93222,"scheduling_latency_s":96.932263,"redis_calls":14,"redis_duration_s":0.0064800000000000005,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001126,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003386,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001968,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.144748,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.14732588,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.200149,"completed_at":"2026-08-20T06:00:20.388Z","load_balancing_strategy":"primary","db_duration_s":0.041677,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2070gitlab # [ 433.695990] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:20.392Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"166bfc00e84757c180880982","created_at":"2026-08-20T05:58:44.086Z","trace_propagation_headers":{"sentry-trace":"3d5d93a5a0a9408380f02a3200731179-5798ec49132f41d6","baggage":"sentry-trace_id=3d5d93a5a0a9408380f02a3200731179,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW046XVJNV4Z86M93AFJ40","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:44.096Z","job_size_bytes":5,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-166bfc00e84757c180880982: start","job_status":"start","queue_duration_s":96.296695,"scheduling_latency_s":96.296742}2071gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'2072gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)2073gitlab # [ 433.867948] nixbot[3574]: INFO: ::ffff:127.0.0.1:59868 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK2074gitlab # [ 433.893715] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:20.684Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"166bfc00e84757c180880982","created_at":"2026-08-20T05:58:44.086Z","trace_propagation_headers":{"sentry-trace":"3d5d93a5a0a9408380f02a3200731179-5798ec49132f41d6","baggage":"sentry-trace_id=3d5d93a5a0a9408380f02a3200731179,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW046XVJNV4Z86M93AFJ40","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:44.096Z","job_size_bytes":5,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-166bfc00e84757c180880982: done: 0.291804 sec","job_status":"done","queue_duration_s":96.296695,"scheduling_latency_s":96.296742,"redis_calls":12,"redis_duration_s":0.007196,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001106,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.005227,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000863,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.028,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.227278,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0008381,"duration_s":0.291804,"completed_at":"2026-08-20T06:00:20.684Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.048684,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2075gitlab # [ 433.988765] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:20.688Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"4cdd0cba07de6757206b30a5","created_at":"2026-08-20T05:58:44.134Z","trace_propagation_headers":{"sentry-trace":"3d5d93a5a0a9408380f02a3200731179-5798ec49132f41d6","baggage":"sentry-trace_id=3d5d93a5a0a9408380f02a3200731179,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW046XVJNV4Z86M93AFJ40","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:44.140Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-4cdd0cba07de6757206b30a5: start","job_status":"start","queue_duration_s":96.548577,"scheduling_latency_s":96.548625}2076gitlab # [ 434.296316] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:21.086Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"4cdd0cba07de6757206b30a5","created_at":"2026-08-20T05:58:44.134Z","trace_propagation_headers":{"sentry-trace":"3d5d93a5a0a9408380f02a3200731179-5798ec49132f41d6","baggage":"sentry-trace_id=3d5d93a5a0a9408380f02a3200731179,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW046XVJNV4Z86M93AFJ40","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:44.140Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-4cdd0cba07de6757206b30a5: done: 0.398136 sec","job_status":"done","queue_duration_s":96.548577,"scheduling_latency_s":96.548625,"redis_calls":11,"redis_duration_s":0.004215,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00114,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002295,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00078,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.05,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.321,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.321,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.048,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.277279,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00059866,"duration_s":0.398136,"completed_at":"2026-08-20T06:00:21.086Z","load_balancing_strategy":"primary","db_duration_s":0.125067,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2077gitlab # [ 434.396214] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:21.089Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"4ff7168379e7f6c339d1fb09","created_at":"2026-08-20T05:58:44.144Z","trace_propagation_headers":{"sentry-trace":"3d5d93a5a0a9408380f02a3200731179-5798ec49132f41d6","baggage":"sentry-trace_id=3d5d93a5a0a9408380f02a3200731179,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW046XVJNV4Z86M93AFJ40","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:44.150Z","job_size_bytes":89,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-4ff7168379e7f6c339d1fb09: start","job_status":"start","queue_duration_s":96.938696,"scheduling_latency_s":96.938727}2078gitlab # [ 434.419125] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:21.146Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"4ff7168379e7f6c339d1fb09","created_at":"2026-08-20T05:58:44.144Z","trace_propagation_headers":{"sentry-trace":"3d5d93a5a0a9408380f02a3200731179-5798ec49132f41d6","baggage":"sentry-trace_id=3d5d93a5a0a9408380f02a3200731179,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW046XVJNV4Z86M93AFJ40","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:44.150Z","job_size_bytes":89,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-4ff7168379e7f6c339d1fb09: done: 0.05718 sec","job_status":"done","queue_duration_s":96.938696,"scheduling_latency_s":96.938727,"redis_calls":11,"redis_duration_s":0.0034860000000000004,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000934,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001917,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000635,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036854,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00061858,"duration_s":0.05718,"completed_at":"2026-08-20T06:00:21.146Z","load_balancing_strategy":"primary","db_duration_s":0.009583,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2079gitlab # [ 434.474632] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:21.148Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 033d7582398e9bef590efff8854214897015f02b refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"fe2de52648f3d85b1d0451cf","created_at":"2026-08-20T05:58:46.995Z","trace_propagation_headers":{"sentry-trace":"9ed8809bbba3488eaec8e63d3ad022e3-c0afda40910d4317","baggage":"sentry-trace_id=9ed8809bbba3488eaec8e63d3ad022e3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW08M1F3TR1VCD5ZDZX01C","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:47.003Z","job_size_bytes":185,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-fe2de52648f3d85b1d0451cf: start","job_status":"start","queue_duration_s":94.145792,"scheduling_latency_s":94.14582}2080gitlab # [ 434.491454] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:21.171Z","message":"changes: \"0000000000000000000000000000000000000000 033d7582398e9bef590efff8854214897015f02b refs/heads/master\\n\""}2081gitlab # [ 434.494371] gitaly[891]: time="2026-08-20T06:00:21.244Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=4 command.system_time_ms=11 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M0EW08M1F3TR1VCD5ZDZX01C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:00:31.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:21.224" grpc.time_ms=19.999 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2082gitlab # [ 434.507715] gitaly[891]: time="2026-08-20T06:00:21.273Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW08M1F3TR1VCD5ZDZX01C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T06:00:31.036" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:00:21.256" grpc.time_ms=16.288 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2083gitlab # [ 434.594106] gitaly[891]: time="2026-08-20T06:00:21.386Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=3 command.system_time_ms=11 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EW08M1F3TR1VCD5ZDZX01C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-20T06:00:31.143" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:21.364" grpc.time_ms=21.863 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2084gitlab # [ 434.681090] gitaly[891]: time="2026-08-20T06:00:21.473Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW08M1F3TR1VCD5ZDZX01C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3937 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:00:21.472" grpc.time_ms=0.992 pid=891 span.kind=server system=grpc2085gitlab # [ 434.741205] gitaly[891]: time="2026-08-20T06:00:21.533Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW08M1F3TR1VCD5ZDZX01C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3939 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:00:21.532" grpc.time_ms=0.869 pid=891 span.kind=server system=grpc2086gitlab # [ 434.770748] gitaly[891]: time="2026-08-20T06:00:21.548Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW08M1F3TR1VCD5ZDZX01C diskcache=a8c1020e-5849-4339-8164-0ff21e661392 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T06:00:31.191" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:00:21.411" pid=891 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2087gitlab # [ 434.792974] gitaly[891]: time="2026-08-20T06:00:21.549Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=148 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5160 command.oublock=8 command.real_time_ms=129 command.spawn_token_fork_ms=1 command.system_time_ms=84 command.user_time_ms=64 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW08M1F3TR1VCD5ZDZX01C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T06:00:31.191" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:00:21.411" grpc.time_ms=137.228 pid=891 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2088gitlab # [ 434.815227] gitaly[891]: time="2026-08-20T06:00:21.583Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW08M1F3TR1VCD5ZDZX01C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T06:00:31.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:00:21.583" grpc.time_ms=0.356 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2089gitlab # [ 434.829736] gitaly[891]: time="2026-08-20T06:00:21.614Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=17 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=860 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=3 command.system_time_ms=14 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW08M1F3TR1VCD5ZDZX01C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-20T06:00:31.010" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:21.591" grpc.time_ms=23.601 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2090gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'2091gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)2092gitlab # [ 434.933043] nixbot[3574]: INFO: ::ffff:127.0.0.1:59882 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK2093gitlab # [ 435.037784] gitaly[891]: time="2026-08-20T06:00:21.830Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=312 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW08M1F3TR1VCD5ZDZX01C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-08-20T06:00:51.016" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:21.817" grpc.time_ms=12.61 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2094gitlab # [ 435.104764] gitaly[891]: time="2026-08-20T06:00:21.897Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW08M1F3TR1VCD5ZDZX01C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T06:00:31.005" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:00:21.896" grpc.time_ms=0.626 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2095gitlab # [ 435.135622] gitaly[891]: time="2026-08-20T06:00:21.914Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=316 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EW08M1F3TR1VCD5ZDZX01C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-20T06:00:31.011" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-08-20T06:00:21.902" grpc.time_ms=12.183 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2096gitlab # [ 435.171392] gitaly[891]: time="2026-08-20T06:00:21.963Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW08M1F3TR1VCD5ZDZX01C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:00:31.054" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:21.945" grpc.time_ms=18.431 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2097gitlab # [ 435.211154] gitaly[891]: time="2026-08-20T06:00:21.993Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M0EW08M1F3TR1VCD5ZDZX01C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:00:31.084" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:21.974" grpc.time_ms=18.278 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2098gitlab # [ 435.254972] gitaly[891]: time="2026-08-20T06:00:22.047Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=22 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=881 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=2 command.system_time_ms=22 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW08M1F3TR1VCD5ZDZX01C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-20T06:00:52.017" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:22.017" grpc.time_ms=29.165 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2099gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'2100gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.06 seconds)2101gitlab # [ 435.991337] nixbot[3574]: INFO: ::ffff:127.0.0.1:59892 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK2102gitlab # [ 436.010381] gitaly[891]: time="2026-08-20T06:00:22.801Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW08M1F3TR1VCD5ZDZX01C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-20T06:00:32.218" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:22.798" grpc.time_ms=2.569 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2103gitlab # [ 436.053451] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:22.844Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 033d7582398e9bef590efff8854214897015f02b refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"fe2de52648f3d85b1d0451cf","created_at":"2026-08-20T05:58:46.995Z","trace_propagation_headers":{"sentry-trace":"9ed8809bbba3488eaec8e63d3ad022e3-c0afda40910d4317","baggage":"sentry-trace_id=9ed8809bbba3488eaec8e63d3ad022e3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW08M1F3TR1VCD5ZDZX01C","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:47.003Z","job_size_bytes":185,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-fe2de52648f3d85b1d0451cf: done: 1.695472 sec","job_status":"done","queue_duration_s":94.145792,"scheduling_latency_s":94.14582,"gitaly_calls":13,"gitaly_duration_s":0.385285,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.074787,"redis_read_bytes":2103,"redis_write_bytes":21749,"redis_cache_calls":15,"redis_cache_duration_s":0.007817,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.010635,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.002785,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7837,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.006751,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.030844,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.015955,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.096,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.35,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.408,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.096,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.156978,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00097504,"exclusive_lock_hold_duration_s":0.06107594,"duration_s":1.695472,"completed_at":"2026-08-20T06:00:22.844Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.171723,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2104gitlab # [ 436.159466] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:22.847Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","033d7582398e9bef590efff8854214897015f02b 1cdfdcaac5d2032ba64a258aa245ab4017e01fcb refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"ff2d1274797530d2baedbc0d","created_at":"2026-08-20T05:58:53.818Z","trace_propagation_headers":{"sentry-trace":"707e073a661644309920658ae761726b-a66f3070ba824616","baggage":"sentry-trace_id=707e073a661644309920658ae761726b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW0EFSQRYSTTJAG1PZY60D","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:53.820Z","job_size_bytes":185,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-ff2d1274797530d2baedbc0d: start","job_status":"start","queue_duration_s":89.026675,"scheduling_latency_s":89.026702}2105gitlab # [ 436.202430] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:22.861Z","message":"changes: \"033d7582398e9bef590efff8854214897015f02b 1cdfdcaac5d2032ba64a258aa245ab4017e01fcb refs/heads/master\\n\""}2106gitlab # [ 436.206947] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:22.933Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"899780cff7d20804e1beea29","created_at":"2026-08-20T06:00:22.929Z","trace_propagation_headers":{"sentry-trace":"707e073a661644309920658ae761726b-5c6bf6cc19fa4d8c","baggage":"sentry-trace_id=707e073a661644309920658ae761726b,sentry-release=Unknown"},"correlation_id":"01M0EW0EFSQRYSTTJAG1PZY60D","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"9fe6c2e4d8d238db0b872f5c","job_size_bytes":46,"pid":3530,"job_status":"deduplicated","message":"ProjectCacheWorker JID-899780cff7d20804e1beea29: deduplicated: until executing","deduplication.type":"until executing"}2107gitlab # [ 436.229890] gitaly[891]: time="2026-08-20T06:00:22.899Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0EFSQRYSTTJAG1PZY60D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:00:32.000" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:22.881" grpc.time_ms=18.295 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2108gitlab # [ 436.246915] gitaly[891]: time="2026-08-20T06:00:22.924Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0EFSQRYSTTJAG1PZY60D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T06:00:32.025" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:00:22.906" grpc.time_ms=18.14 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2109gitlab # [ 436.261984] gitaly[891]: time="2026-08-20T06:00:22.971Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0EFSQRYSTTJAG1PZY60D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-20T06:00:32.077" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:22.958" grpc.time_ms=13.455 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2110gitlab # [ 436.275868] gitaly[891]: time="2026-08-20T06:00:22.999Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=597 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0EFSQRYSTTJAG1PZY60D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-08-20T06:00:52.178" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:22.978" grpc.time_ms=21.124 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2111gitlab # [ 436.291838] gitaly[891]: time="2026-08-20T06:00:23.032Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=319 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0EFSQRYSTTJAG1PZY60D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-20T06:00:33.010" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-08-20T06:00:23.020" grpc.time_ms=11.984 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2112gitlab # [ 436.305877] gitaly[891]: time="2026-08-20T06:00:23.067Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0EFSQRYSTTJAG1PZY60D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:00:33.039" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:23.050" grpc.time_ms=17.452 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2113gitlab # [ 436.536837] gitaly[891]: time="2026-08-20T06:00:23.328Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0EFSQRYSTTJAG1PZY60D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-20T06:00:33.006" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:23.326" grpc.time_ms=2.12 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2114gitlab # [ 436.580530] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:23.372Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","033d7582398e9bef590efff8854214897015f02b 1cdfdcaac5d2032ba64a258aa245ab4017e01fcb refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"ff2d1274797530d2baedbc0d","created_at":"2026-08-20T05:58:53.818Z","trace_propagation_headers":{"sentry-trace":"707e073a661644309920658ae761726b-a66f3070ba824616","baggage":"sentry-trace_id=707e073a661644309920658ae761726b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW0EFSQRYSTTJAG1PZY60D","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:53.820Z","job_size_bytes":185,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-ff2d1274797530d2baedbc0d: done: 0.525243 sec","job_status":"done","queue_duration_s":89.026675,"scheduling_latency_s":89.026702,"gitaly_calls":7,"gitaly_duration_s":0.130639,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.029662,"redis_read_bytes":500,"redis_write_bytes":11943,"redis_cache_calls":9,"redis_cache_duration_s":0.003147,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001313,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5720,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.004554,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.009633,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.011015,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.039,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.038,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.038,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.039,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.355318,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00082596,"exclusive_lock_hold_duration_s":0.02891618,"duration_s":0.525243,"completed_at":"2026-08-20T06:00:23.372Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.040079,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2115gitlab # [ 436.679978] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:23.374Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"016f78897ecc009b6e186344","created_at":"2026-08-20T05:58:54.277Z","trace_propagation_headers":{"sentry-trace":"abfced6007b24f24b55f70853a92c5b6-b6d67bf6bba948e5","baggage":"sentry-trace_id=abfced6007b24f24b55f70853a92c5b6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW0G0WRPS4F5JTAZ2Z6KZ3","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:54.298Z","job_size_bytes":65,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-016f78897ecc009b6e186344: start","job_status":"start","queue_duration_s":89.075804,"scheduling_latency_s":89.075834}2116gitlab # [ 436.709778] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:23.501Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"016f78897ecc009b6e186344","created_at":"2026-08-20T05:58:54.277Z","trace_propagation_headers":{"sentry-trace":"abfced6007b24f24b55f70853a92c5b6-b6d67bf6bba948e5","baggage":"sentry-trace_id=abfced6007b24f24b55f70853a92c5b6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW0G0WRPS4F5JTAZ2Z6KZ3","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:54.298Z","job_size_bytes":65,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-016f78897ecc009b6e186344: done: 0.126856 sec","job_status":"done","queue_duration_s":89.075804,"scheduling_latency_s":89.075834,"redis_calls":16,"redis_duration_s":0.006474,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.003338,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002044,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001092,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.078499,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00062682,"duration_s":0.126856,"completed_at":"2026-08-20T06:00:23.501Z","load_balancing_strategy":"primary","db_duration_s":0.039023,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2117gitlab # [ 436.766175] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:23.503Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"a42c4b5ae01aa799396884f1","created_at":"2026-08-20T05:58:54.302Z","trace_propagation_headers":{"sentry-trace":"abfced6007b24f24b55f70853a92c5b6-b6d67bf6bba948e5","baggage":"sentry-trace_id=abfced6007b24f24b55f70853a92c5b6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW0G0WRPS4F5JTAZ2Z6KZ3","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:54.318Z","job_size_bytes":65,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-a42c4b5ae01aa799396884f1: start","job_status":"start","queue_duration_s":89.185458,"scheduling_latency_s":89.185483}2118gitlab # [ 436.873388] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:23.665Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"a42c4b5ae01aa799396884f1","created_at":"2026-08-20T05:58:54.302Z","trace_propagation_headers":{"sentry-trace":"abfced6007b24f24b55f70853a92c5b6-b6d67bf6bba948e5","baggage":"sentry-trace_id=abfced6007b24f24b55f70853a92c5b6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW0G0WRPS4F5JTAZ2Z6KZ3","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:54.318Z","job_size_bytes":65,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-a42c4b5ae01aa799396884f1: done: 0.161183 sec","job_status":"done","queue_duration_s":89.185458,"scheduling_latency_s":89.185483,"redis_calls":21,"redis_duration_s":0.00738,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.003021,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001943,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002416,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.044,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.033,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.095958,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00064132,"duration_s":0.161183,"completed_at":"2026-08-20T06:00:23.664Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.052416,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2119gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'2120gitlab # [ 436.980265] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:23.667Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"026f7cb02f8a5f86d4b6497c","created_at":"2026-08-20T05:58:54.556Z","trace_propagation_headers":{"sentry-trace":"abfced6007b24f24b55f70853a92c5b6-b6d67bf6bba948e5","baggage":"sentry-trace_id=abfced6007b24f24b55f70853a92c5b6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW0G0WRPS4F5JTAZ2Z6KZ3","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:54.567Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-026f7cb02f8a5f86d4b6497c: start","job_status":"start","queue_duration_s":89.100456,"scheduling_latency_s":89.100483}2121gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.07 seconds)2122gitlab # [ 437.060326] nixbot[3574]: INFO: ::ffff:127.0.0.1:59902 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK2123gitlab # [ 437.175195] gitaly[891]: time="2026-08-20T06:00:23.966Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW0G0WRPS4F5JTAZ2Z6KZ3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:00:23.965" grpc.time_ms=0.817 pid=891 span.kind=server system=grpc2124gitlab # [ 437.223875] gitaly[891]: time="2026-08-20T06:00:24.016Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW0G0WRPS4F5JTAZ2Z6KZ3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:00:24.015" grpc.time_ms=0.657 pid=891 span.kind=server system=grpc2125gitlab # [ 437.283526] gitaly[891]: time="2026-08-20T06:00:24.075Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW0G0WRPS4F5JTAZ2Z6KZ3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:00:24.074" grpc.time_ms=0.742 pid=891 span.kind=server system=grpc2126gitlab # [ 437.312880] gitaly[891]: time="2026-08-20T06:00:24.090Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0G0WRPS4F5JTAZ2Z6KZ3 diskcache=a52e3c72-c605-4bb6-8682-0a472dbdb1da grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T06:00:53.004" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:23.904" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2127gitlab # [ 437.334331] gitaly[891]: time="2026-08-20T06:00:24.091Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=205 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7408 command.oublock=0 command.real_time_ms=177 command.spawn_token_fork_ms=1 command.system_time_ms=127 command.user_time_ms=78 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0G0WRPS4F5JTAZ2Z6KZ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T06:00:53.004" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:23.904" grpc.time_ms=186.321 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2128gitlab # [ 437.503442] gitaly[891]: time="2026-08-20T06:00:24.295Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0G0WRPS4F5JTAZ2Z6KZ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T06:00:54.293" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:24.293" grpc.time_ms=1.74 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2129gitlab # [ 437.562355] gitaly[891]: time="2026-08-20T06:00:24.354Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0G0WRPS4F5JTAZ2Z6KZ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:00:54.352" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:24.352" grpc.time_ms=1.408 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2130gitlab # [ 437.600911] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:24.381Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"026f7cb02f8a5f86d4b6497c","created_at":"2026-08-20T05:58:54.556Z","trace_propagation_headers":{"sentry-trace":"abfced6007b24f24b55f70853a92c5b6-b6d67bf6bba948e5","baggage":"sentry-trace_id=abfced6007b24f24b55f70853a92c5b6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW0G0WRPS4F5JTAZ2Z6KZ3","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:54.567Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-026f7cb02f8a5f86d4b6497c: done: 0.713948 sec","job_status":"done","queue_duration_s":89.100456,"scheduling_latency_s":89.100483,"gitaly_calls":3,"gitaly_duration_s":0.200506,"redis_calls":117,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.04016,"redis_read_bytes":457,"redis_write_bytes":27997,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002662,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001808,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.013534,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":25,"redis_queues_duration_s":0.005546,"redis_queues_read_bytes":36,"redis_queues_write_bytes":14491,"redis_queues_metadata_calls":21,"redis_queues_metadata_duration_s":0.008086,"redis_queues_metadata_read_bytes":32,"redis_queues_metadata_write_bytes":3370,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.001087,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001331,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003444,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.103,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.044,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.052,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.049,"db_ci_duration_s":0.054,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.375245,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.62624478,"duration_s":0.713948,"completed_at":"2026-08-20T06:00:24.381Z","load_balancing_strategy":"primary","db_duration_s":0.126229,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2131gitlab # [ 437.682086] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:24.383Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"9fe6c2e4d8d238db0b872f5c","created_at":"2026-08-20T06:00:21.279Z","trace_propagation_headers":{"sentry-trace":"9ed8809bbba3488eaec8e63d3ad022e3-a2c8b876201840d7","baggage":"sentry-trace_id=9ed8809bbba3488eaec8e63d3ad022e3,sentry-release=Unknown"},"correlation_id":"01M0EW08M1F3TR1VCD5ZDZX01C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:21.313Z","job_size_bytes":46,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-9fe6c2e4d8d238db0b872f5c: start","job_status":"start","queue_duration_s":3.070381,"scheduling_latency_s":3.070405}2132gitlab # [ 437.698800] gitaly[891]: time="2026-08-20T06:00:24.452Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW08M1F3TR1VCD5ZDZX01C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-08-20T12:00:24.441" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:00:24.441" grpc.time_ms=10.017 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2133gitlab # [ 437.709339] gitaly[891]: time="2026-08-20T06:00:24.478Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW08M1F3TR1VCD5ZDZX01C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-20T06:00:54.061" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:24.462" grpc.time_ms=15.534 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2134gitlab # [ 437.723358] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:24.515Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"9fe6c2e4d8d238db0b872f5c","created_at":"2026-08-20T06:00:21.279Z","trace_propagation_headers":{"sentry-trace":"9ed8809bbba3488eaec8e63d3ad022e3-a2c8b876201840d7","baggage":"sentry-trace_id=9ed8809bbba3488eaec8e63d3ad022e3,sentry-release=Unknown"},"correlation_id":"01M0EW08M1F3TR1VCD5ZDZX01C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:21.313Z","job_size_bytes":46,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-9fe6c2e4d8d238db0b872f5c: done: 0.131593 sec","job_status":"done","queue_duration_s":3.070381,"scheduling_latency_s":3.070405,"gitaly_calls":2,"gitaly_duration_s":0.032283,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.00924,"redis_read_bytes":69,"redis_write_bytes":4881,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001877,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000814,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2114,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002121,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.003494,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":748,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000934,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.072114,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00039728,"duration_s":0.131593,"completed_at":"2026-08-20T06:00:24.515Z","load_balancing_strategy":"primary","db_duration_s":0.018096,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2135gitlab # [ 437.774130] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:24.517Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"06c21a650c0950a9a966c9a7","created_at":"2026-08-20T06:00:21.345Z","trace_propagation_headers":{"sentry-trace":"9ed8809bbba3488eaec8e63d3ad022e3-a2c8b876201840d7","baggage":"sentry-trace_id=9ed8809bbba3488eaec8e63d3ad022e3,sentry-release=Unknown"},"correlation_id":"01M0EW08M1F3TR1VCD5ZDZX01C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:21.356Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-06c21a650c0950a9a966c9a7: start","job_status":"start","queue_duration_s":3.160996,"scheduling_latency_s":3.161019}2136gitlab # [ 437.796752] gitaly[891]: time="2026-08-20T06:00:24.589Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW08M1F3TR1VCD5ZDZX01C diskcache=aaf2d0b5-6161-4b1f-b0c8-f690f36a9ba9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T12:00:24.546" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:24.547" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2137gitlab # [ 437.806791] gitaly[891]: time="2026-08-20T06:00:24.589Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=27 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1171 command.oublock=0 command.real_time_ms=48 command.spawn_token_fork_ms=4 command.system_time_ms=23 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW08M1F3TR1VCD5ZDZX01C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T12:00:24.546" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:24.547" grpc.time_ms=42.201 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2138gitlab # [ 437.855572] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:24.647Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"06c21a650c0950a9a966c9a7","created_at":"2026-08-20T06:00:21.345Z","trace_propagation_headers":{"sentry-trace":"9ed8809bbba3488eaec8e63d3ad022e3-a2c8b876201840d7","baggage":"sentry-trace_id=9ed8809bbba3488eaec8e63d3ad022e3,sentry-release=Unknown"},"correlation_id":"01M0EW08M1F3TR1VCD5ZDZX01C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:21.356Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-06c21a650c0950a9a966c9a7: done: 0.130129 sec","job_status":"done","queue_duration_s":3.160996,"scheduling_latency_s":3.161019,"gitaly_calls":1,"gitaly_duration_s":0.045807,"redis_calls":15,"redis_duration_s":0.004642,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00051,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001475,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000914,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001743,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.017,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.03,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.052073,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.09989904,"duration_s":0.130129,"completed_at":"2026-08-20T06:00:24.647Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.026607,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2139gitlab # [ 437.912269] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:24.649Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"e764824b3b26d217c3a13a2b","created_at":"2026-08-20T06:00:21.573Z","trace_propagation_headers":{"sentry-trace":"9ed8809bbba3488eaec8e63d3ad022e3-a2c8b876201840d7","baggage":"sentry-trace_id=9ed8809bbba3488eaec8e63d3ad022e3,sentry-release=Unknown"},"correlation_id":"01M0EW08M1F3TR1VCD5ZDZX01C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:21.577Z","job_size_bytes":23,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-e764824b3b26d217c3a13a2b: start","job_status":"start","queue_duration_s":3.072335,"scheduling_latency_s":3.072362}2140gitlab # [ 437.927345] gitaly[891]: time="2026-08-20T06:00:24.706Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW08M1F3TR1VCD5ZDZX01C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-20T06:00:54.286" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:24.687" grpc.time_ms=19.368 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2141gitlab # [ 437.940752] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:24.729Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"e764824b3b26d217c3a13a2b","created_at":"2026-08-20T06:00:21.573Z","trace_propagation_headers":{"sentry-trace":"9ed8809bbba3488eaec8e63d3ad022e3-a2c8b876201840d7","baggage":"sentry-trace_id=9ed8809bbba3488eaec8e63d3ad022e3,sentry-release=Unknown"},"correlation_id":"01M0EW08M1F3TR1VCD5ZDZX01C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:21.577Z","job_size_bytes":23,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-e764824b3b26d217c3a13a2b: done: 0.079211 sec","job_status":"done","queue_duration_s":3.072335,"scheduling_latency_s":3.072362,"gitaly_calls":1,"gitaly_duration_s":0.022682,"redis_calls":16,"redis_duration_s":0.006298,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.00068,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001825,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.002446,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001347,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043691,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.079211,"completed_at":"2026-08-20T06:00:24.729Z","load_balancing_strategy":"primary","db_duration_s":0.004958,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2142gitlab # [ 437.987294] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:24.733Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"1c44a5dc1f843f0a5d1fa462","created_at":"2026-08-20T06:00:22.512Z","trace_propagation_headers":{"sentry-trace":"9ed8809bbba3488eaec8e63d3ad022e3-a2c8b876201840d7","baggage":"sentry-trace_id=9ed8809bbba3488eaec8e63d3ad022e3,sentry-release=Unknown"},"correlation_id":"01M0EW08M1F3TR1VCD5ZDZX01C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1cd59bbc492a085767a825b05685026f5d0d55b4f0b68e0d00d90cf1411f0ad4","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:22.525Z","job_size_bytes":467,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-1c44a5dc1f843f0a5d1fa462: start","job_status":"start","queue_duration_s":2.207682,"scheduling_latency_s":2.207733}2143gitlab # [ 438.008131] gitaly[891]: time="2026-08-20T06:00:24.800Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW08M1F3TR1VCD5ZDZX01C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:00:54.398" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:24.799" grpc.time_ms=1.082 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2144gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'2145gitlab # [ 438.045953] gitaly[891]: time="2026-08-20T06:00:24.818Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW08M1F3TR1VCD5ZDZX01C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T06:00:34.004" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:24.805" grpc.time_ms=13.453 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2146gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.07 seconds)2147gitlab # [ 438.125545] nixbot[3574]: INFO: ::ffff:127.0.0.1:59916 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK2148gitlab # [ 438.263316] gitaly[891]: time="2026-08-20T06:00:25.054Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW08M1F3TR1VCD5ZDZX01C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T06:00:55.052" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:25.052" grpc.time_ms=1.662 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2149gitlab # [ 438.302229] gitaly[891]: time="2026-08-20T06:00:25.065Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=33 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0EW08M1F3TR1VCD5ZDZX01C error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-20T06:00:55.059" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:25.060" grpc.time_ms=4.646 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2150gitlab # [ 438.467729] gitaly[891]: time="2026-08-20T06:00:25.259Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EW08M1F3TR1VCD5ZDZX01C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:00:35.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:25.241" grpc.time_ms=18.397 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2151gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'2152gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.05 seconds)2153gitlab # [ 439.174542] nixbot[3574]: INFO: ::ffff:127.0.0.1:59920 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK2154gitlab # [ 439.356732] gitaly[891]: time="2026-08-20T06:00:26.147Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=23 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=881 command.oublock=0 command.real_time_ms=25 command.spawn_token_fork_ms=3 command.system_time_ms=12 command.user_time_ms=11 component=gitaly.StreamServerInterceptor correlation_id=01M0EW08M1F3TR1VCD5ZDZX01C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-20T06:00:56.117" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:26.118" grpc.time_ms=29.586 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2155gitlab # [ 439.404093] gitaly[891]: time="2026-08-20T06:00:26.179Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW08M1F3TR1VCD5ZDZX01C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-20T06:00:56.153" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:26.154" grpc.time_ms=25.177 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2156gitlab # [ 439.459507] sidekiq-cluster[3530]: {"severity":"WARN","time":"2026-08-20T06:00:26.250Z","class":"CreatePipelineWorker","correlation_id":"01M0EW08M1F3TR1VCD5ZDZX01C","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"033d7582398e9bef590efff8854214897015f02b","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"033d7582398e9bef590efff8854214897015f02b","ref":"refs/heads/master"},"retry":0}2157gitlab # [ 439.481547] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:26.267Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"1c44a5dc1f843f0a5d1fa462","created_at":"2026-08-20T06:00:22.512Z","trace_propagation_headers":{"sentry-trace":"9ed8809bbba3488eaec8e63d3ad022e3-a2c8b876201840d7","baggage":"sentry-trace_id=9ed8809bbba3488eaec8e63d3ad022e3,sentry-release=Unknown"},"correlation_id":"01M0EW08M1F3TR1VCD5ZDZX01C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1cd59bbc492a085767a825b05685026f5d0d55b4f0b68e0d00d90cf1411f0ad4","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:22.525Z","job_size_bytes":467,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-1c44a5dc1f843f0a5d1fa462: done: 1.534482 sec","job_status":"done","queue_duration_s":2.207682,"scheduling_latency_s":2.207733,"gitaly_calls":7,"gitaly_duration_s":0.122966,"redis_calls":51,"redis_duration_s":0.019267,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.001531,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.009102,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002404,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.004228,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002002,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.059,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.051,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.318293,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00070008,"duration_s":1.534482,"completed_at":"2026-08-20T06:00:26.267Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.1021,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2158gitlab # [ 439.569683] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:26.270Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"34a52c2f-0570-4077-95f4-c8d8d44eae9f\"}"],"class":"WebHookWorker","jid":"2f050d502d346f73f3301478","created_at":"2026-08-20T06:00:22.752Z","trace_propagation_headers":{"sentry-trace":"9ed8809bbba3488eaec8e63d3ad022e3-a2c8b876201840d7","baggage":"sentry-trace_id=9ed8809bbba3488eaec8e63d3ad022e3,sentry-release=Unknown"},"correlation_id":"01M0EW08M1F3TR1VCD5ZDZX01C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f5fbc8f86b2d0b34c847c46fdda054472a22badbea81e937b6b57162e78ec925","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:22.759Z","job_size_bytes":1751,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-2f050d502d346f73f3301478: start","job_status":"start","queue_duration_s":3.510887,"scheduling_latency_s":3.510931}2159gitlab # [ 439.692620] nixbot[3574]: INFO: ::ffff:127.0.0.1:59924 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2160gitlab # [ 439.737200] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:26.528Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"34a52c2f-0570-4077-95f4-c8d8d44eae9f\"}"],"class":"WebHookWorker","jid":"2f050d502d346f73f3301478","created_at":"2026-08-20T06:00:22.752Z","trace_propagation_headers":{"sentry-trace":"9ed8809bbba3488eaec8e63d3ad022e3-a2c8b876201840d7","baggage":"sentry-trace_id=9ed8809bbba3488eaec8e63d3ad022e3,sentry-release=Unknown"},"correlation_id":"01M0EW08M1F3TR1VCD5ZDZX01C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f5fbc8f86b2d0b34c847c46fdda054472a22badbea81e937b6b57162e78ec925","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:22.759Z","job_size_bytes":1751,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-2f050d502d346f73f3301478: done: 0.257531 sec","job_status":"done","queue_duration_s":3.510887,"scheduling_latency_s":3.510931,"redis_calls":19,"redis_duration_s":0.0072970000000000005,"redis_read_bytes":32,"redis_write_bytes":5367,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001858,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000862,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003046,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001531,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.09039620000004334,"cpu_s":0.142378,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0007727,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.257531,"completed_at":"2026-08-20T06:00:26.528Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006016,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2161gitlab # [ 439.844264] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:26.532Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"362f1688d8fbacd069841b7b","created_at":"2026-08-20T06:00:22.945Z","trace_propagation_headers":{"sentry-trace":"707e073a661644309920658ae761726b-5c6bf6cc19fa4d8c","baggage":"sentry-trace_id=707e073a661644309920658ae761726b,sentry-release=Unknown"},"correlation_id":"01M0EW0EFSQRYSTTJAG1PZY60D","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"06c21a650c0950a9a966c9a7","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:22.950Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-362f1688d8fbacd069841b7b: start","job_status":"start","queue_duration_s":3.581914,"scheduling_latency_s":3.581966}2162gitlab # [ 439.867975] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:26.625Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"362f1688d8fbacd069841b7b","created_at":"2026-08-20T06:00:22.945Z","trace_propagation_headers":{"sentry-trace":"707e073a661644309920658ae761726b-5c6bf6cc19fa4d8c","baggage":"sentry-trace_id=707e073a661644309920658ae761726b,sentry-release=Unknown"},"correlation_id":"01M0EW0EFSQRYSTTJAG1PZY60D","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"06c21a650c0950a9a966c9a7","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:22.950Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-362f1688d8fbacd069841b7b: done: 0.093207 sec","job_status":"done","queue_duration_s":3.581914,"scheduling_latency_s":3.581966,"gitaly_calls":1,"gitaly_duration_s":0.017484,"redis_calls":12,"redis_duration_s":0.005253,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002072,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001184,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001997,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.011,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.011,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.054381,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.05085362,"duration_s":0.093207,"completed_at":"2026-08-20T06:00:26.625Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013834,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2163gitlab # [ 439.916926] gitaly[891]: time="2026-08-20T06:00:26.589Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0EFSQRYSTTJAG1PZY60D diskcache=aacaaa9b-500f-498e-853f-fe2f77d143b0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T12:00:26.575" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:26.576" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2164gitlab # [ 439.927120] gitaly[891]: time="2026-08-20T06:00:26.589Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=290 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0EFSQRYSTTJAG1PZY60D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T12:00:26.575" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:26.576" grpc.time_ms=13.328 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2165gitlab # [ 439.940923] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:26.630Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"c01ebec30a7ce37bbda33241","created_at":"2026-08-20T06:00:23.149Z","trace_propagation_headers":{"sentry-trace":"707e073a661644309920658ae761726b-5c6bf6cc19fa4d8c","baggage":"sentry-trace_id=707e073a661644309920658ae761726b,sentry-release=Unknown"},"correlation_id":"01M0EW0EFSQRYSTTJAG1PZY60D","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a5d60d3bce18b0b81c6b47041f52b598ac0c4accfff43f337af87e04e7d887bc","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:23.152Z","job_size_bytes":467,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-c01ebec30a7ce37bbda33241: start","job_status":"start","queue_duration_s":3.477385,"scheduling_latency_s":3.477447}2166gitlab # [ 439.959079] gitaly[891]: time="2026-08-20T06:00:26.677Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0EFSQRYSTTJAG1PZY60D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:00:56.274" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:26.675" grpc.time_ms=1.127 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2167gitlab # [ 439.972447] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:26 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1962168gitlab # [ 439.974586] gitaly[891]: time="2026-08-20T06:00:26.697Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0EFSQRYSTTJAG1PZY60D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T06:00:36.010" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:26.681" grpc.time_ms=16.02 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2169gitlab # [ 439.988094] gitaly[891]: time="2026-08-20T06:00:26.733Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=3 command.system_time_ms=7 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M0EW3AN8Z4RNA259QN76MCXJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:26.713" grpc.time_ms=19.965 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc2170gitlab # [ 440.001615] gitaly[891]: time="2026-08-20T06:00:26.765Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0EFSQRYSTTJAG1PZY60D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T06:00:56.363" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:26.764" grpc.time_ms=1.092 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2171gitlab # [ 440.014620] gitaly[891]: time="2026-08-20T06:00:26.774Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=28 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0EFSQRYSTTJAG1PZY60D error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-20T06:00:56.370" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:26.770" grpc.time_ms=3.409 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2172gitlab # [ 440.048645] gitaly[891]: time="2026-08-20T06:00:26.841Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0EFSQRYSTTJAG1PZY60D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:00:36.021" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:26.822" grpc.time_ms=18.388 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2173gitlab # [ 440.146687] gitaly[891]: time="2026-08-20T06:00:26.938Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3AVGPS5KR2ZP02FH5CC2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:26.920" pid=891 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2174gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'2175gitlab # [ 440.170916] gitaly[891]: time="2026-08-20T06:00:26.939Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3AVGPS5KR2ZP02FH5CC2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:26.920" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc2176gitlab # [ 440.192606] gitlab-workhorse[818]: time="2026-08-20T06:00:26Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672177gitlab # [ 440.195287] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:26 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 2032178gitlab # [ 440.202416] gitaly[891]: time="2026-08-20T06:00:26.940Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3AVGPS5KR2ZP02FH5CC2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:26.920" grpc.time_ms=19.511 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc2179gitlab # [ 440.224810] nixbot[3574]: {"ts": "2026-08-20T06:00:27.001Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}2180gitlab # [ 440.238664] nixbot[3574]: INFO: ::ffff:127.0.0.1:59926 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK2181gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.07 seconds)2182gitlab # [ 440.330956] gitaly[891]: time="2026-08-20T06:00:27.123Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3B4MWT1K6Y8K6KH6YFT0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:00:57.020" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:27.121" grpc.time_ms=1.623 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2183gitlab # [ 440.465503] gitaly[891]: time="2026-08-20T06:00:27.256Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=10 component=gitaly.StreamServerInterceptor correlation_id=01M0EW3B4MWT1K6Y8K6KH6YFT0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:00:37.148" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:27.238" grpc.time_ms=17.793 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2184gitlab # [ 440.567526] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:27 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/033d7582398e9bef590efff8854214897015f02b HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 3302185gitlab # [ 440.580385] nixbot[3574]: {"ts": "2026-08-20T06:00:27.361Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/033d7582398e9bef590efff8854214897015f02b \"HTTP/1.1 201 Created\""}2186gitlab # [ 440.584904] gitaly[891]: time="2026-08-20T06:00:27.376Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=880 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=1 command.system_time_ms=17 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0EFSQRYSTTJAG1PZY60D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-20T06:00:57.347" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:27.348" grpc.time_ms=28.034 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2187gitlab # [ 440.617630] gitaly[891]: time="2026-08-20T06:00:27.409Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=3 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0EFSQRYSTTJAG1PZY60D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-20T06:00:57.382" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:27.383" grpc.time_ms=26.427 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2188gitlab # [ 440.650450] gitaly[891]: time="2026-08-20T06:00:27.442Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3BF77BV75FHF78H66ADF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:00:57.340" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:27.441" grpc.time_ms=0.929 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2189gitlab # [ 440.676527] sidekiq-cluster[3530]: {"severity":"WARN","time":"2026-08-20T06:00:27.430Z","class":"CreatePipelineWorker","correlation_id":"01M0EW0EFSQRYSTTJAG1PZY60D","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"033d7582398e9bef590efff8854214897015f02b","after":"1cdfdcaac5d2032ba64a258aa245ab4017e01fcb","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"1cdfdcaac5d2032ba64a258aa245ab4017e01fcb","ref":"refs/heads/master"},"retry":0}2190gitlab # [ 440.688691] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:27.438Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"c01ebec30a7ce37bbda33241","created_at":"2026-08-20T06:00:23.149Z","trace_propagation_headers":{"sentry-trace":"707e073a661644309920658ae761726b-5c6bf6cc19fa4d8c","baggage":"sentry-trace_id=707e073a661644309920658ae761726b,sentry-release=Unknown"},"correlation_id":"01M0EW0EFSQRYSTTJAG1PZY60D","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a5d60d3bce18b0b81c6b47041f52b598ac0c4accfff43f337af87e04e7d887bc","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:23.152Z","job_size_bytes":467,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-c01ebec30a7ce37bbda33241: done: 0.808359 sec","job_status":"done","queue_duration_s":3.477385,"scheduling_latency_s":3.477447,"gitaly_calls":7,"gitaly_duration_s":0.122892,"redis_calls":33,"redis_duration_s":0.008317999999999999,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000843,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001619,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.004624,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001232,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.038,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.033,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.653884,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.808359,"completed_at":"2026-08-20T06:00:27.438Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.037577,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2191gitlab # [ 440.751921] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:27.441Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"3e9f4011-a83e-4507-8e03-b91ae7d4efa4\"}"],"class":"WebHookWorker","jid":"df5ba75baa4e12cbb5937a79","created_at":"2026-08-20T06:00:23.305Z","trace_propagation_headers":{"sentry-trace":"707e073a661644309920658ae761726b-5c6bf6cc19fa4d8c","baggage":"sentry-trace_id=707e073a661644309920658ae761726b,sentry-release=Unknown"},"correlation_id":"01M0EW0EFSQRYSTTJAG1PZY60D","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0ff8d9871a7e1a39cb912b8f3366f2e927fdc2dea2e9666cb2fe2d63800c3979","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:23.308Z","job_size_bytes":1749,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-df5ba75baa4e12cbb5937a79: start","job_status":"start","queue_duration_s":4.132363,"scheduling_latency_s":4.132395}2192gitlab # [ 440.770539] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:27.510Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"3e9f4011-a83e-4507-8e03-b91ae7d4efa4\"}"],"class":"WebHookWorker","jid":"df5ba75baa4e12cbb5937a79","created_at":"2026-08-20T06:00:23.305Z","trace_propagation_headers":{"sentry-trace":"707e073a661644309920658ae761726b-5c6bf6cc19fa4d8c","baggage":"sentry-trace_id=707e073a661644309920658ae761726b,sentry-release=Unknown"},"correlation_id":"01M0EW0EFSQRYSTTJAG1PZY60D","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0ff8d9871a7e1a39cb912b8f3366f2e927fdc2dea2e9666cb2fe2d63800c3979","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:23.308Z","job_size_bytes":1749,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-df5ba75baa4e12cbb5937a79: done: 0.069094 sec","job_status":"done","queue_duration_s":4.132363,"scheduling_latency_s":4.132395,"redis_calls":14,"redis_duration_s":0.004881,"redis_read_bytes":26,"redis_write_bytes":4683,"redis_queues_calls":2,"redis_queues_duration_s":0.000797,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3727,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002629,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001455,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.011792039999988901,"cpu_s":0.041337,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.069094,"completed_at":"2026-08-20T06:00:27.510Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003614,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2193gitlab # [ 440.819476] nixbot[3574]: INFO: ::ffff:127.0.0.1:59928 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2194gitlab # [ 440.820908] gitaly[891]: time="2026-08-20T06:00:27.567Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW3BF77BV75FHF78H66ADF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:00:37.218" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:27.558" grpc.time_ms=9.299 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2195gitlab # [ 440.834594] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:27.514Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"3d894f8364db6e09ead9b9f8","created_at":"2026-08-20T06:00:23.880Z","trace_propagation_headers":{"sentry-trace":"abfced6007b24f24b55f70853a92c5b6-77de0241b8564431","baggage":"sentry-trace_id=abfced6007b24f24b55f70853a92c5b6,sentry-release=Unknown"},"correlation_id":"01M0EW0G0WRPS4F5JTAZ2Z6KZ3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:23.888Z","job_size_bytes":23,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-3d894f8364db6e09ead9b9f8: start","job_status":"start","queue_duration_s":3.626041,"scheduling_latency_s":3.626076}2196gitlab # [ 440.851274] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:27.633Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"3d894f8364db6e09ead9b9f8","created_at":"2026-08-20T06:00:23.880Z","trace_propagation_headers":{"sentry-trace":"abfced6007b24f24b55f70853a92c5b6-77de0241b8564431","baggage":"sentry-trace_id=abfced6007b24f24b55f70853a92c5b6,sentry-release=Unknown"},"correlation_id":"01M0EW0G0WRPS4F5JTAZ2Z6KZ3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:23.888Z","job_size_bytes":23,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-3d894f8364db6e09ead9b9f8: done: 0.11883 sec","job_status":"done","queue_duration_s":3.626041,"scheduling_latency_s":3.626076,"redis_calls":10,"redis_duration_s":0.002375,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000349,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001363,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000663,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.01,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.01,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.08837,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00040872,"duration_s":0.11883,"completed_at":"2026-08-20T06:00:27.632Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.02559,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2197gitlab # [ 440.897668] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:27.634Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"d53274b21d14f1394b3b220a","created_at":"2026-08-20T06:00:24.102Z","trace_propagation_headers":{"sentry-trace":"abfced6007b24f24b55f70853a92c5b6-77de0241b8564431","baggage":"sentry-trace_id=abfced6007b24f24b55f70853a92c5b6,sentry-release=Unknown"},"correlation_id":"01M0EW0G0WRPS4F5JTAZ2Z6KZ3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:24.116Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-d53274b21d14f1394b3b220a: start","job_status":"start","queue_duration_s":3.518917,"scheduling_latency_s":3.518944}2198gitlab # [ 440.914604] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:27 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/033d7582398e9bef590efff8854214897015f02b HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 3232199gitlab # [ 440.917200] nixbot[3574]: {"ts": "2026-08-20T06:00:27.692Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/033d7582398e9bef590efff8854214897015f02b \"HTTP/1.1 201 Created\""}2200gitlab # [ 440.927854] gitaly[891]: time="2026-08-20T06:00:27.720Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW3BKRTDS1FGEQ1G5HDQPY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:27.700" grpc.time_ms=19.388 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc2201gitlab # [ 440.941744] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:27 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 2082202gitlab # [ 441.003267] gitaly[891]: time="2026-08-20T06:00:27.795Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3BSP4K0Q3QM3DW6C42KT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:00:57.194" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:27.794" grpc.time_ms=0.78 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2203gitlab # [ 441.029031] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:27.820Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"d53274b21d14f1394b3b220a","created_at":"2026-08-20T06:00:24.102Z","trace_propagation_headers":{"sentry-trace":"abfced6007b24f24b55f70853a92c5b6-77de0241b8564431","baggage":"sentry-trace_id=abfced6007b24f24b55f70853a92c5b6,sentry-release=Unknown"},"correlation_id":"01M0EW0G0WRPS4F5JTAZ2Z6KZ3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:24.116Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-d53274b21d14f1394b3b220a: done: 0.186047 sec","job_status":"done","queue_duration_s":3.518917,"scheduling_latency_s":3.518944,"redis_calls":10,"redis_duration_s":0.002232,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000414,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001145,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000673,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.172215,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00029708,"duration_s":0.186047,"completed_at":"2026-08-20T06:00:27.820Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004941,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2204gitlab # [ 441.079552] gitaly[891]: time="2026-08-20T06:00:27.835Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3BTAZNFBC9NBAN6547SJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:27.817" pid=891 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2205gitlab # [ 441.090737] gitlab-workhorse[818]: time="2026-08-20T06:00:27Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672206gitlab # [ 441.092727] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:27 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1132207gitlab # [ 441.094710] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:27.822Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"3157ea2134d9979cab8c0449","created_at":"2026-08-20T06:00:24.145Z","trace_propagation_headers":{"sentry-trace":"abfced6007b24f24b55f70853a92c5b6-77de0241b8564431","baggage":"sentry-trace_id=abfced6007b24f24b55f70853a92c5b6,sentry-release=Unknown"},"correlation_id":"01M0EW0G0WRPS4F5JTAZ2Z6KZ3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:24.157Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-3157ea2134d9979cab8c0449: start","job_status":"start","queue_duration_s":3.66552,"scheduling_latency_s":3.665548}2208gitlab # [ 441.110916] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:27.878Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"3157ea2134d9979cab8c0449","created_at":"2026-08-20T06:00:24.145Z","trace_propagation_headers":{"sentry-trace":"abfced6007b24f24b55f70853a92c5b6-77de0241b8564431","baggage":"sentry-trace_id=abfced6007b24f24b55f70853a92c5b6,sentry-release=Unknown"},"correlation_id":"01M0EW0G0WRPS4F5JTAZ2Z6KZ3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:24.157Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-3157ea2134d9979cab8c0449: done: 0.055598 sec","job_status":"done","queue_duration_s":3.66552,"scheduling_latency_s":3.665548,"redis_calls":10,"redis_duration_s":0.002571,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000458,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001621,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000492,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034148,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036268,"duration_s":0.055598,"completed_at":"2026-08-20T06:00:27.878Z","load_balancing_strategy":"primary","db_duration_s":0.012918,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2209gitlab # [ 441.155272] gitaly[891]: time="2026-08-20T06:00:27.835Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=3 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3BTAZNFBC9NBAN6547SJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:27.817" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc2210gitlab # [ 441.168761] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:27.880Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"3782431239b085faed12bb4f","created_at":"2026-08-20T06:00:24.187Z","trace_propagation_headers":{"sentry-trace":"abfced6007b24f24b55f70853a92c5b6-77de0241b8564431","baggage":"sentry-trace_id=abfced6007b24f24b55f70853a92c5b6,sentry-release=Unknown"},"correlation_id":"01M0EW0G0WRPS4F5JTAZ2Z6KZ3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:24.196Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-3782431239b085faed12bb4f: start","job_status":"start","queue_duration_s":3.683432,"scheduling_latency_s":3.68346}2211gitlab # [ 441.184231] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:27.929Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"3782431239b085faed12bb4f","created_at":"2026-08-20T06:00:24.187Z","trace_propagation_headers":{"sentry-trace":"abfced6007b24f24b55f70853a92c5b6-77de0241b8564431","baggage":"sentry-trace_id=abfced6007b24f24b55f70853a92c5b6,sentry-release=Unknown"},"correlation_id":"01M0EW0G0WRPS4F5JTAZ2Z6KZ3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:24.196Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-3782431239b085faed12bb4f: done: 0.049239 sec","job_status":"done","queue_duration_s":3.683432,"scheduling_latency_s":3.68346,"redis_calls":13,"redis_duration_s":0.002485,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000292,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000931,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000784,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000478,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031376,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025672,"duration_s":0.049239,"completed_at":"2026-08-20T06:00:27.929Z","load_balancing_strategy":"primary","db_duration_s":0.006737,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2212gitlab # [ 441.229585] gitaly[891]: time="2026-08-20T06:00:27.835Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=3 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3BTAZNFBC9NBAN6547SJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:27.817" grpc.time_ms=17.824 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc2213gitlab # [ 441.244448] nixbot[3574]: {"ts": "2026-08-20T06:00:27.965Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/033d7582398e9bef590efff8854214897015f02b \"HTTP/1.1 201 Created\""}2214gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'2215gitlab # [ 441.247176] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:27.931Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"980d2ff00630792c3c38003d","created_at":"2026-08-20T06:00:24.197Z","trace_propagation_headers":{"sentry-trace":"abfced6007b24f24b55f70853a92c5b6-77de0241b8564431","baggage":"sentry-trace_id=abfced6007b24f24b55f70853a92c5b6,sentry-release=Unknown"},"correlation_id":"01M0EW0G0WRPS4F5JTAZ2Z6KZ3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:24.207Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-980d2ff00630792c3c38003d: start","job_status":"start","queue_duration_s":3.724106,"scheduling_latency_s":3.724128}2216gitlab # [ 441.262708] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:27.968Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"980d2ff00630792c3c38003d","created_at":"2026-08-20T06:00:24.197Z","trace_propagation_headers":{"sentry-trace":"abfced6007b24f24b55f70853a92c5b6-77de0241b8564431","baggage":"sentry-trace_id=abfced6007b24f24b55f70853a92c5b6,sentry-release=Unknown"},"correlation_id":"01M0EW0G0WRPS4F5JTAZ2Z6KZ3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:24.207Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-980d2ff00630792c3c38003d: done: 0.037026 sec","job_status":"done","queue_duration_s":3.724106,"scheduling_latency_s":3.724128,"redis_calls":10,"redis_duration_s":0.001475,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000308,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000865,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000302,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026303,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024818,"duration_s":0.037026,"completed_at":"2026-08-20T06:00:27.968Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004984,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2217gitlab # [ 441.308151] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:27 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/033d7582398e9bef590efff8854214897015f02b HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2612218gitlab # [ 441.310614] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:28 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1472219gitlab # [ 441.312707] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:28 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1502220gitlab # [ 441.314770] gitaly[891]: time="2026-08-20T06:00:27.857Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW3BSP4K0Q3QM3DW6C42KT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:00:37.074" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:27.844" grpc.time_ms=13.072 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2221gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.09 seconds)2222gitlab # [ 441.328377] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:27.970Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"1c8eb835b243f10e6bc44fd1","created_at":"2026-08-20T06:00:24.208Z","trace_propagation_headers":{"sentry-trace":"abfced6007b24f24b55f70853a92c5b6-77de0241b8564431","baggage":"sentry-trace_id=abfced6007b24f24b55f70853a92c5b6,sentry-release=Unknown"},"correlation_id":"01M0EW0G0WRPS4F5JTAZ2Z6KZ3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:24.217Z","job_size_bytes":19,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-1c8eb835b243f10e6bc44fd1: start","job_status":"start","queue_duration_s":3.752875,"scheduling_latency_s":3.752897}2223gitlab # [ 441.344842] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:28.008Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"1c8eb835b243f10e6bc44fd1","created_at":"2026-08-20T06:00:24.208Z","trace_propagation_headers":{"sentry-trace":"abfced6007b24f24b55f70853a92c5b6-77de0241b8564431","baggage":"sentry-trace_id=abfced6007b24f24b55f70853a92c5b6,sentry-release=Unknown"},"correlation_id":"01M0EW0G0WRPS4F5JTAZ2Z6KZ3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:24.217Z","job_size_bytes":19,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-1c8eb835b243f10e6bc44fd1: done: 0.038024 sec","job_status":"done","queue_duration_s":3.752875,"scheduling_latency_s":3.752897,"redis_calls":11,"redis_duration_s":0.0016909999999999998,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000337,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001004,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00035,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022435,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002505,"duration_s":0.038024,"completed_at":"2026-08-20T06:00:28.008Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007115,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2224gitlab # [ 441.389325] gitaly[891]: time="2026-08-20T06:00:28.063Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=8 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW3C0C9RE2TAPE59NCJ0YE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:28.049" grpc.time_ms=14.274 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc2225gitlab # [ 441.402756] nixbot[3574]: INFO: ::ffff:127.0.0.1:48526 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK2226gitlab # [ 441.404872] gitlab-workhorse[818]: time="2026-08-20T06:00:28Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672227gitlab # [ 441.406764] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:28 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1092228gitlab # [ 441.408884] gitlab-workhorse[818]: time="2026-08-20T06:00:28Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2212229gitlab # [ 441.410855] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:28 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 221 "" "git/2.55.0" 1282230gitlab # [ 441.413142] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:28.009Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"3250e0a56123576d349cea76","created_at":"2026-08-20T06:00:24.222Z","trace_propagation_headers":{"sentry-trace":"abfced6007b24f24b55f70853a92c5b6-77de0241b8564431","baggage":"sentry-trace_id=abfced6007b24f24b55f70853a92c5b6,sentry-release=Unknown"},"correlation_id":"01M0EW0G0WRPS4F5JTAZ2Z6KZ3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:24.229Z","job_size_bytes":66,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-3250e0a56123576d349cea76: start","job_status":"start","queue_duration_s":3.780586,"scheduling_latency_s":3.780606}2231gitlab # [ 441.431930] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:28.045Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"3250e0a56123576d349cea76","created_at":"2026-08-20T06:00:24.222Z","trace_propagation_headers":{"sentry-trace":"abfced6007b24f24b55f70853a92c5b6-77de0241b8564431","baggage":"sentry-trace_id=abfced6007b24f24b55f70853a92c5b6,sentry-release=Unknown"},"correlation_id":"01M0EW0G0WRPS4F5JTAZ2Z6KZ3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:24.229Z","job_size_bytes":66,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-3250e0a56123576d349cea76: done: 0.035872 sec","job_status":"done","queue_duration_s":3.780586,"scheduling_latency_s":3.780606,"redis_calls":10,"redis_duration_s":0.001473,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000317,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000833,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000323,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024248,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000249,"duration_s":0.035872,"completed_at":"2026-08-20T06:00:28.045Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004654,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2232gitlab # [ 441.479816] gitaly[891]: time="2026-08-20T06:00:28.067Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=6 command.system_time_ms=0 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M0EW3C0DJD1ZHRRQSYYKK6DZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:28.051" grpc.time_ms=14.143 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc2233gitlab # [ 441.494867] gitaly[891]: time="2026-08-20T06:00:28.180Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3C58JPR2H9P7RNWYDRMK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:28.169" pid=891 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2234gitlab # [ 441.505670] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:28.047Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"2e61307d576fd0f815c114b3","created_at":"2026-08-20T06:00:24.230Z","trace_propagation_headers":{"sentry-trace":"abfced6007b24f24b55f70853a92c5b6-77de0241b8564431","baggage":"sentry-trace_id=abfced6007b24f24b55f70853a92c5b6,sentry-release=Unknown"},"correlation_id":"01M0EW0G0WRPS4F5JTAZ2Z6KZ3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:24.236Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-2e61307d576fd0f815c114b3: start","job_status":"start","queue_duration_s":3.810144,"scheduling_latency_s":3.810165}2235gitlab # [ 441.522701] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:28.103Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"2e61307d576fd0f815c114b3","created_at":"2026-08-20T06:00:24.230Z","trace_propagation_headers":{"sentry-trace":"abfced6007b24f24b55f70853a92c5b6-77de0241b8564431","baggage":"sentry-trace_id=abfced6007b24f24b55f70853a92c5b6,sentry-release=Unknown"},"correlation_id":"01M0EW0G0WRPS4F5JTAZ2Z6KZ3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:24.236Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-2e61307d576fd0f815c114b3: done: 0.05619 sec","job_status":"done","queue_duration_s":3.810144,"scheduling_latency_s":3.810165,"redis_calls":10,"redis_duration_s":0.0044469999999999996,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001063,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003058,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000326,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034229,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00027738,"duration_s":0.05619,"completed_at":"2026-08-20T06:00:28.103Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008582,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2236gitlab # [ 441.569494] nix-daemon[3796]: accepted connection from pid 4404, user nixbot2237gitlab # [ 441.570625] gitaly[891]: time="2026-08-20T06:00:28.180Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3C58JPR2H9P7RNWYDRMK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:28.169" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc2238gitlab # [ 441.585052] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:28.104Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"87350c5ef5f8876103776318","created_at":"2026-08-20T06:00:24.246Z","trace_propagation_headers":{"sentry-trace":"abfced6007b24f24b55f70853a92c5b6-77de0241b8564431","baggage":"sentry-trace_id=abfced6007b24f24b55f70853a92c5b6,sentry-release=Unknown"},"correlation_id":"01M0EW0G0WRPS4F5JTAZ2Z6KZ3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:24.252Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-87350c5ef5f8876103776318: start","job_status":"start","queue_duration_s":3.852658,"scheduling_latency_s":3.852682}2239gitlab # [ 441.602251] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:28.147Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"87350c5ef5f8876103776318","created_at":"2026-08-20T06:00:24.246Z","trace_propagation_headers":{"sentry-trace":"abfced6007b24f24b55f70853a92c5b6-77de0241b8564431","baggage":"sentry-trace_id=abfced6007b24f24b55f70853a92c5b6,sentry-release=Unknown"},"correlation_id":"01M0EW0G0WRPS4F5JTAZ2Z6KZ3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:24.252Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-87350c5ef5f8876103776318: done: 0.04321 sec","job_status":"done","queue_duration_s":3.852658,"scheduling_latency_s":3.852682,"redis_calls":10,"redis_duration_s":0.0016099999999999999,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000335,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000926,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000349,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025559,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003102,"duration_s":0.04321,"completed_at":"2026-08-20T06:00:28.147Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010273,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2240gitlab # [ 441.647802] gitaly[891]: time="2026-08-20T06:00:28.180Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3C58JPR2H9P7RNWYDRMK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:28.169" grpc.time_ms=11.583 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc2241gitlab # [ 441.662859] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:28.149Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"69d42fa39cb4f9a80ecdf462","created_at":"2026-08-20T06:00:24.252Z","trace_propagation_headers":{"sentry-trace":"abfced6007b24f24b55f70853a92c5b6-77de0241b8564431","baggage":"sentry-trace_id=abfced6007b24f24b55f70853a92c5b6,sentry-release=Unknown"},"correlation_id":"01M0EW0G0WRPS4F5JTAZ2Z6KZ3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:24.257Z","job_size_bytes":6,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-69d42fa39cb4f9a80ecdf462: start","job_status":"start","queue_duration_s":3.891745,"scheduling_latency_s":3.891768}2242gitlab # [ 441.679557] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:28.189Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"69d42fa39cb4f9a80ecdf462","created_at":"2026-08-20T06:00:24.252Z","trace_propagation_headers":{"sentry-trace":"abfced6007b24f24b55f70853a92c5b6-77de0241b8564431","baggage":"sentry-trace_id=abfced6007b24f24b55f70853a92c5b6,sentry-release=Unknown"},"correlation_id":"01M0EW0G0WRPS4F5JTAZ2Z6KZ3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:24.257Z","job_size_bytes":6,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-69d42fa39cb4f9a80ecdf462: done: 0.040621 sec","job_status":"done","queue_duration_s":3.891745,"scheduling_latency_s":3.891768,"redis_calls":10,"redis_duration_s":0.0038710000000000003,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000734,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002631,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000506,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018942,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00041238,"duration_s":0.040621,"completed_at":"2026-08-20T06:00:28.189Z","load_balancing_strategy":"primary","db_duration_s":0.006218,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2243gitlab # [ 441.726274] gitaly[891]: time="2026-08-20T06:00:28.194Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3C52P03Y3FRE935A0MTN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:28.175" pid=891 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=221 span.kind=server system=grpc2244gitlab # [ 441.736816] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:28.191Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"73794571adf885b1df6cdf78","created_at":"2026-08-20T06:00:24.258Z","trace_propagation_headers":{"sentry-trace":"abfced6007b24f24b55f70853a92c5b6-77de0241b8564431","baggage":"sentry-trace_id=abfced6007b24f24b55f70853a92c5b6,sentry-release=Unknown"},"correlation_id":"01M0EW0G0WRPS4F5JTAZ2Z6KZ3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:24.263Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-73794571adf885b1df6cdf78: start","job_status":"start","queue_duration_s":3.927854,"scheduling_latency_s":3.927875}2245gitlab # [ 441.752624] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:28.255Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"73794571adf885b1df6cdf78","created_at":"2026-08-20T06:00:24.258Z","trace_propagation_headers":{"sentry-trace":"abfced6007b24f24b55f70853a92c5b6-77de0241b8564431","baggage":"sentry-trace_id=abfced6007b24f24b55f70853a92c5b6,sentry-release=Unknown"},"correlation_id":"01M0EW0G0WRPS4F5JTAZ2Z6KZ3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:24.263Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-73794571adf885b1df6cdf78: done: 0.063773 sec","job_status":"done","queue_duration_s":3.927854,"scheduling_latency_s":3.927875,"redis_calls":10,"redis_duration_s":0.006004,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001467,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003791,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000746,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033739,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00052072,"duration_s":0.063773,"completed_at":"2026-08-20T06:00:28.255Z","load_balancing_strategy":"primary","db_duration_s":0.015236,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2246gitlab # [ 441.796810] gitaly[891]: time="2026-08-20T06:00:28.194Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1104 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=3 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3C52P03Y3FRE935A0MTN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:28.175" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc2247gitlab # [ 441.810982] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:28.257Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"7e6d934535fbf8912676b47b","created_at":"2026-08-20T06:00:24.271Z","trace_propagation_headers":{"sentry-trace":"abfced6007b24f24b55f70853a92c5b6-77de0241b8564431","baggage":"sentry-trace_id=abfced6007b24f24b55f70853a92c5b6,sentry-release=Unknown"},"correlation_id":"01M0EW0G0WRPS4F5JTAZ2Z6KZ3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:24.277Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-7e6d934535fbf8912676b47b: start","job_status":"start","queue_duration_s":3.979728,"scheduling_latency_s":3.979758}2248gitlab # [ 441.827996] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:28.360Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"7e6d934535fbf8912676b47b","created_at":"2026-08-20T06:00:24.271Z","trace_propagation_headers":{"sentry-trace":"abfced6007b24f24b55f70853a92c5b6-77de0241b8564431","baggage":"sentry-trace_id=abfced6007b24f24b55f70853a92c5b6,sentry-release=Unknown"},"correlation_id":"01M0EW0G0WRPS4F5JTAZ2Z6KZ3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:24.277Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-7e6d934535fbf8912676b47b: done: 0.103563 sec","job_status":"done","queue_duration_s":3.979728,"scheduling_latency_s":3.979758,"redis_calls":14,"redis_duration_s":0.006271,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000468,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004294,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001509,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.014,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.066208,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0009096,"duration_s":0.103563,"completed_at":"2026-08-20T06:00:28.360Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.022846,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2249gitlab # [ 441.873604] gitaly[891]: time="2026-08-20T06:00:28.194Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1104 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=3 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3C52P03Y3FRE935A0MTN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:28.175" grpc.time_ms=18.883 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc2250gitlab # [ 441.888859] nixbot[3574]: {"ts": "2026-08-20T06:00:28.636Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1cdfdcaac5d2032ba64a258aa245ab4017e01fcb \"HTTP/1.1 201 Created\""}2251gitlab # [ 441.891576] nixbot[3574]: {"ts": "2026-08-20T06:00:28.643Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-1cdfdcaac5d2-3"}2252gitlab # [ 441.895141] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:28.363Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"b1c178b181515078f8a4a351","created_at":"2026-08-20T06:00:24.491Z","trace_propagation_headers":{"sentry-trace":"9ed8809bbba3488eaec8e63d3ad022e3-2a300990c9584b1f","baggage":"sentry-trace_id=9ed8809bbba3488eaec8e63d3ad022e3,sentry-release=Unknown"},"correlation_id":"01M0EW08M1F3TR1VCD5ZDZX01C","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:24.498Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-b1c178b181515078f8a4a351: start","job_status":"start","queue_duration_s":3.865093,"scheduling_latency_s":3.865127}2253gitlab # [ 441.911888] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:28.434Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"b1c178b181515078f8a4a351","created_at":"2026-08-20T06:00:24.491Z","trace_propagation_headers":{"sentry-trace":"9ed8809bbba3488eaec8e63d3ad022e3-2a300990c9584b1f","baggage":"sentry-trace_id=9ed8809bbba3488eaec8e63d3ad022e3,sentry-release=Unknown"},"correlation_id":"01M0EW08M1F3TR1VCD5ZDZX01C","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:24.498Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-b1c178b181515078f8a4a351: done: 0.071155 sec","job_status":"done","queue_duration_s":3.865093,"scheduling_latency_s":3.865127,"redis_calls":19,"redis_duration_s":0.00724,"redis_read_bytes":21,"redis_write_bytes":4290,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001881,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000574,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2261,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.004088,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000697,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04828,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0103877,"duration_s":0.071155,"completed_at":"2026-08-20T06:00:28.434Z","load_balancing_strategy":"primary","db_duration_s":0.010036,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2254gitlab # [ 441.960289] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:28 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 3962255gitlab # [ 441.963147] gitaly[891]: time="2026-08-20T06:00:28.321Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3CADET86A0A4AZ1E2Q21 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:00:58.220" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:28.320" grpc.time_ms=0.529 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2256gitlab # [ 441.977029] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:28.436Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","2f050d502d346f73f3301478"],"class":"WebHooks::LogExecutionWorker","jid":"124d55915e82c9ad42e53652","created_at":"2026-08-20T06:00:26.491Z","trace_propagation_headers":{"sentry-trace":"9ed8809bbba3488eaec8e63d3ad022e3-15ea8a78ffc140d7","baggage":"sentry-trace_id=9ed8809bbba3488eaec8e63d3ad022e3,sentry-release=Unknown"},"correlation_id":"01M0EW08M1F3TR1VCD5ZDZX01C","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:530d3f388c016c846551dec4bfa92de616a2734eaa29ea6f512ad2437ae695cd","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:26.506Z","job_size_bytes":2592,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-124d55915e82c9ad42e53652: start","job_status":"start","queue_duration_s":1.930132,"scheduling_latency_s":1.930163}2257gitlab # [ 441.994612] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:28.498Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","2f050d502d346f73f3301478"],"class":"WebHooks::LogExecutionWorker","jid":"124d55915e82c9ad42e53652","created_at":"2026-08-20T06:00:26.491Z","trace_propagation_headers":{"sentry-trace":"9ed8809bbba3488eaec8e63d3ad022e3-15ea8a78ffc140d7","baggage":"sentry-trace_id=9ed8809bbba3488eaec8e63d3ad022e3,sentry-release=Unknown"},"correlation_id":"01M0EW08M1F3TR1VCD5ZDZX01C","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:530d3f388c016c846551dec4bfa92de616a2734eaa29ea6f512ad2437ae695cd","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:26.506Z","job_size_bytes":2592,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-124d55915e82c9ad42e53652: done: 0.062051 sec","job_status":"done","queue_duration_s":1.930132,"scheduling_latency_s":1.930163,"redis_calls":10,"redis_duration_s":0.002125,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000312,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001357,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000456,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039059,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00028022,"duration_s":0.062051,"completed_at":"2026-08-20T06:00:28.498Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012471,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2258gitlab # [ 442.041747] nix-daemon[3796]: accepted connection from pid 4449, user nixbot2259gitlab # [ 442.042729] nix-daemon[3796]: accepted connection from pid 4474, user nixbot2260gitlab # [ 442.043736] gitaly[891]: time="2026-08-20T06:00:28.342Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=590 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=3 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW3CADET86A0A4AZ1E2Q21 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-20T06:00:58.233" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:28.333" grpc.time_ms=8.721 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2261gitlab # [ 442.058540] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:28.499Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"7518aaf8de7e92ce6558a77f","created_at":"2026-08-20T06:00:27.323Z","trace_propagation_headers":{"sentry-trace":"5119334c55d14c41a58b75d288f2b26e-bdceb004cef24774","baggage":"sentry-trace_id=5119334c55d14c41a58b75d288f2b26e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW3B4MWT1K6Y8K6KH6YFT0","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:27.332Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-7518aaf8de7e92ce6558a77f: start","job_status":"start","queue_duration_s":1.167608,"scheduling_latency_s":1.167637}2262gitlab # [ 442.075195] nixbot[3574]: {"ts": "2026-08-20T06:00:28.806Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-1cdfdcaac5d2-3", "argv0": "bwrap"}2263gitlab # [ 442.078732] gitaly[891]: time="2026-08-20T06:00:28.361Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M0EW3CADET86A0A4AZ1E2Q21 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:00:38.262" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:28.352" grpc.time_ms=8.453 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2264gitlab # [ 442.092993] gitaly[891]: time="2026-08-20T06:00:28.384Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3CADET86A0A4AZ1E2Q21 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T06:00:38.293" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:00:28.384" grpc.time_ms=0.292 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2265gitlab # [ 442.105299] gitaly[891]: time="2026-08-20T06:00:28.399Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=569 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3CADET86A0A4AZ1E2Q21 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T06:00:38.299" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:28.389" grpc.time_ms=9.474 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2266gitlab # [ 442.119569] gitaly[891]: time="2026-08-20T06:00:28.450Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW3CADET86A0A4AZ1E2Q21 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:00:28.449" grpc.time_ms=0.613 pid=891 span.kind=server system=grpc2267gitlab # [ 442.129845] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:28.890Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"7518aaf8de7e92ce6558a77f","created_at":"2026-08-20T06:00:27.323Z","trace_propagation_headers":{"sentry-trace":"5119334c55d14c41a58b75d288f2b26e-bdceb004cef24774","baggage":"sentry-trace_id=5119334c55d14c41a58b75d288f2b26e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW3B4MWT1K6Y8K6KH6YFT0","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:27.332Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3530,"job_status":"rescheduled","message":"PipelineProcessWorker JID-7518aaf8de7e92ce6558a77f: rescheduled"}2268gitlab # [ 442.145832] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:28.907Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"7518aaf8de7e92ce6558a77f","created_at":"2026-08-20T06:00:27.323Z","trace_propagation_headers":{"sentry-trace":"5119334c55d14c41a58b75d288f2b26e-bdceb004cef24774","baggage":"sentry-trace_id=5119334c55d14c41a58b75d288f2b26e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW3B4MWT1K6Y8K6KH6YFT0","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:27.332Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-7518aaf8de7e92ce6558a77f: done: 0.40806 sec","job_status":"done","queue_duration_s":1.167608,"scheduling_latency_s":1.167637,"gitaly_calls":3,"gitaly_duration_s":0.153893,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.02087,"redis_read_bytes":151,"redis_write_bytes":18012,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000657,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001199,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.003902,"redis_queues_read_bytes":29,"redis_queues_write_bytes":12311,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.011107,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000379,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000516,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002453,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.056,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.01,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.01,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.03,"db_ci_duration_s":0.026,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.188249,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.34185638,"duration_s":0.40806,"completed_at":"2026-08-20T06:00:28.907Z","load_balancing_strategy":"primary","db_duration_s":0.057479,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2269gitlab # [ 442.199286] gitaly[891]: time="2026-08-20T06:00:28.491Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW3CADET86A0A4AZ1E2Q21 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4156 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:00:28.490" grpc.time_ms=0.822 pid=891 span.kind=server system=grpc2270gitlab # [ 442.209252] gitaly[891]: time="2026-08-20T06:00:28.499Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3CADET86A0A4AZ1E2Q21 diskcache=16626c61-bda2-40c3-a0be-e13c44cb2232 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T06:00:38.001" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:00:28.401" pid=891 ref=refs/keep-around/1cdfdcaac5d2032ba64a258aa245ab4017e01fcb remote_ip="2001:db8:1::1" revision=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb span.kind=server system=grpc username=root2271gitlab # [ 442.220914] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:28.912Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","df5ba75baa4e12cbb5937a79"],"class":"WebHooks::LogExecutionWorker","jid":"43f3f3d4813d890356e35a73","created_at":"2026-08-20T06:00:27.483Z","trace_propagation_headers":{"sentry-trace":"707e073a661644309920658ae761726b-a3131e428e6c4aae","baggage":"sentry-trace_id=707e073a661644309920658ae761726b,sentry-release=Unknown"},"correlation_id":"01M0EW0EFSQRYSTTJAG1PZY60D","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e8213c29cf29f63125bee60099639005f69cb2f2558f255f7d138c9472e437c7","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:27.491Z","job_size_bytes":2591,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-43f3f3d4813d890356e35a73: start","job_status":"start","queue_duration_s":1.421116,"scheduling_latency_s":1.421166}2272gitlab # [ 442.237957] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:28.992Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","df5ba75baa4e12cbb5937a79"],"class":"WebHooks::LogExecutionWorker","jid":"43f3f3d4813d890356e35a73","created_at":"2026-08-20T06:00:27.483Z","trace_propagation_headers":{"sentry-trace":"707e073a661644309920658ae761726b-a3131e428e6c4aae","baggage":"sentry-trace_id=707e073a661644309920658ae761726b,sentry-release=Unknown"},"correlation_id":"01M0EW0EFSQRYSTTJAG1PZY60D","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e8213c29cf29f63125bee60099639005f69cb2f2558f255f7d138c9472e437c7","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:27.491Z","job_size_bytes":2591,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-43f3f3d4813d890356e35a73: done: 0.080462 sec","job_status":"done","queue_duration_s":1.421116,"scheduling_latency_s":1.421166,"redis_calls":7,"redis_duration_s":0.002572,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00189,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000682,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.033,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.033,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037064,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.080462,"completed_at":"2026-08-20T06:00:28.992Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.035803,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2273gitlab # [ 442.281207] gitaly[891]: time="2026-08-20T06:00:28.499Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=87 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5651 command.oublock=8 command.real_time_ms=91 command.spawn_token_fork_ms=0 command.system_time_ms=55 command.user_time_ms=32 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3CADET86A0A4AZ1E2Q21 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T06:00:38.001" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:00:28.401" grpc.time_ms=97.651 pid=891 ref=refs/keep-around/1cdfdcaac5d2032ba64a258aa245ab4017e01fcb remote_ip="2001:db8:1::1" revision=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb span.kind=server system=grpc username=root2274gitlab # [ 442.296201] nix-daemon[3796]: accepted connection from pid 4485, user nixbot2275gitlab # [ 442.297141] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:28.994Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"46a1586fde9ab33991119788","created_at":"2026-08-20T06:00:28.416Z","trace_propagation_headers":{"sentry-trace":"9ed8809bbba3488eaec8e63d3ad022e3-f439d81341a24008","baggage":"sentry-trace_id=9ed8809bbba3488eaec8e63d3ad022e3,sentry-release=Unknown"},"correlation_id":"01M0EW08M1F3TR1VCD5ZDZX01C","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:28.423Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-46a1586fde9ab33991119788: start","job_status":"start","queue_duration_s":0.571763,"scheduling_latency_s":0.571795}2276gitlab # [ 442.315504] gitaly[891]: time="2026-08-20T06:00:28.504Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3CADET86A0A4AZ1E2Q21 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:00:58.403" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:28.503" grpc.time_ms=0.496 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2277gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb'2278gitlab # [ 442.328694] gitaly[891]: time="2026-08-20T06:00:28.647Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW3B4MWT1K6Y8K6KH6YFT0 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:00:28.646" grpc.time_ms=1.086 pid=891 span.kind=server system=grpc2279gitlab # [ 442.338261] gitaly[891]: time="2026-08-20T06:00:28.682Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW3B4MWT1K6Y8K6KH6YFT0 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:00:28.681" grpc.time_ms=0.544 pid=891 span.kind=server system=grpc2280gitlab # [ 442.347176] gitaly[891]: time="2026-08-20T06:00:28.723Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW3B4MWT1K6Y8K6KH6YFT0 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:00:28.722" grpc.time_ms=0.609 pid=891 span.kind=server system=grpc2281gitlab # [ 442.356381] nix-daemon[3796]: accepted connection from pid 4495, user nixbot2282gitlab # [ 442.357246] gitaly[891]: time="2026-08-20T06:00:28.733Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3B4MWT1K6Y8K6KH6YFT0 diskcache=724bef06-6f5b-441c-a836-005dca8c0520 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T06:00:58.193" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:28.593" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2283gitlab # [ 442.366109] gitaly[891]: time="2026-08-20T06:00:28.733Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=131 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7243 command.oublock=0 command.real_time_ms=133 command.spawn_token_fork_ms=1 command.system_time_ms=66 command.user_time_ms=65 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3B4MWT1K6Y8K6KH6YFT0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T06:00:58.193" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:28.593" grpc.time_ms=139.71 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2284gitlab # [ 442.378386] gitaly[891]: time="2026-08-20T06:00:28.811Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW3B4MWT1K6Y8K6KH6YFT0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T06:00:58.409" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:28.809" grpc.time_ms=1.331 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2285gitlab # [ 442.391357] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:29.163Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"46a1586fde9ab33991119788","created_at":"2026-08-20T06:00:28.416Z","trace_propagation_headers":{"sentry-trace":"9ed8809bbba3488eaec8e63d3ad022e3-f439d81341a24008","baggage":"sentry-trace_id=9ed8809bbba3488eaec8e63d3ad022e3,sentry-release=Unknown"},"correlation_id":"01M0EW08M1F3TR1VCD5ZDZX01C","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:28.423Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-46a1586fde9ab33991119788: done: 0.168965 sec","job_status":"done","queue_duration_s":0.571763,"scheduling_latency_s":0.571795,"redis_calls":11,"redis_duration_s":0.0024479999999999997,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000363,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001651,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000434,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.008,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.013,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.126767,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004006,"duration_s":0.168965,"completed_at":"2026-08-20T06:00:29.163Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.034811,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2286gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', in 0.11 seconds)2287(finished: subtest: push delivers the webhook, in 97.90 seconds)2288subtest: eval and build post commit statuses2289gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1cdfdcaac5d2032ba64a258aa245ab4017e01fcb/statuses2290gitlab # [ 442.437161] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:29.166Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"8e728c3c297770e61b3161d6","created_at":"2026-08-20T06:00:28.506Z","trace_propagation_headers":{"sentry-trace":"b62c6e4ff3bc444780fae483c7cd16d9-47984093f8a04ffc","baggage":"sentry-trace_id=b62c6e4ff3bc444780fae483c7cd16d9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW3CADET86A0A4AZ1E2Q21","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:28.512Z","job_size_bytes":65,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-8e728c3c297770e61b3161d6: start","job_status":"start","queue_duration_s":0.653384,"scheduling_latency_s":0.653435}2291gitlab # [ 442.453992] gitaly[891]: time="2026-08-20T06:00:28.868Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3B4MWT1K6Y8K6KH6YFT0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:00:58.465" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:28.866" grpc.time_ms=1.245 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2292gitlab # [ 442.467140] nix-daemon[3796]: accepted connection from pid 4502, user nixbot2293gitlab # [ 442.468738] nixbot[3574]: INFO: ::ffff:127.0.0.1:48540 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 200 OK2294gitlab # [ 442.470746] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:29.232Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"8e728c3c297770e61b3161d6","created_at":"2026-08-20T06:00:28.506Z","trace_propagation_headers":{"sentry-trace":"b62c6e4ff3bc444780fae483c7cd16d9-47984093f8a04ffc","baggage":"sentry-trace_id=b62c6e4ff3bc444780fae483c7cd16d9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW3CADET86A0A4AZ1E2Q21","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:28.512Z","job_size_bytes":65,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-8e728c3c297770e61b3161d6: done: 0.065759 sec","job_status":"done","queue_duration_s":0.653384,"scheduling_latency_s":0.653435,"redis_calls":7,"redis_duration_s":0.008319,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003632,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004687,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042379,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.065759,"completed_at":"2026-08-20T06:00:29.231Z","load_balancing_strategy":"primary","db_duration_s":0.008985,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2295gitlab # [ 442.516040] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:29.236Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"588569d04d6c5d7fdf881f5b","created_at":"2026-08-20T06:00:28.514Z","trace_propagation_headers":{"sentry-trace":"b62c6e4ff3bc444780fae483c7cd16d9-47984093f8a04ffc","baggage":"sentry-trace_id=b62c6e4ff3bc444780fae483c7cd16d9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW3CADET86A0A4AZ1E2Q21","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:28.518Z","job_size_bytes":65,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-588569d04d6c5d7fdf881f5b: start","job_status":"start","queue_duration_s":0.717455,"scheduling_latency_s":0.717515}2296gitlab # [ 442.535757] nix-daemon[3796]: accepted connection from pid 4485, user nixbot2297gitlab # [ 442.593632] gitaly[891]: time="2026-08-20T06:00:29.385Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3DC572RJCS6XQC0X23W2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:00:59.283" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:29.383" grpc.time_ms=1.036 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2298gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1cdfdcaac5d2032ba64a258aa245ab4017e01fcb/statuses, in 0.22 seconds)2299gitlab # [ 442.624943] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:29.416Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"588569d04d6c5d7fdf881f5b","created_at":"2026-08-20T06:00:28.514Z","trace_propagation_headers":{"sentry-trace":"b62c6e4ff3bc444780fae483c7cd16d9-47984093f8a04ffc","baggage":"sentry-trace_id=b62c6e4ff3bc444780fae483c7cd16d9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW3CADET86A0A4AZ1E2Q21","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:28.518Z","job_size_bytes":65,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-588569d04d6c5d7fdf881f5b: done: 0.180257 sec","job_status":"done","queue_duration_s":0.717455,"scheduling_latency_s":0.717515,"redis_calls":10,"redis_duration_s":0.005201,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002101,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.0031,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.038,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.03,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.116503,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.180257,"completed_at":"2026-08-20T06:00:29.416Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.040876,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2300gitlab # [ 442.689043] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:29.419Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"4f79ec3c366a2c8c72e2ef57","created_at":"2026-08-20T06:00:28.583Z","trace_propagation_headers":{"sentry-trace":"5119334c55d14c41a58b75d288f2b26e-8df22816090447a6","baggage":"sentry-trace_id=5119334c55d14c41a58b75d288f2b26e,sentry-release=Unknown"},"correlation_id":"01M0EW3B4MWT1K6Y8K6KH6YFT0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:28.586Z","job_size_bytes":23,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-4f79ec3c366a2c8c72e2ef57: start","job_status":"start","queue_duration_s":0.832822,"scheduling_latency_s":0.832866}2301gitlab # [ 442.707827] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:29 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/1cdfdcaac5d2032ba64a258aa245ab4017e01fcb/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1062302gitlab # [ 442.714846] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:29.506Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"4f79ec3c366a2c8c72e2ef57","created_at":"2026-08-20T06:00:28.583Z","trace_propagation_headers":{"sentry-trace":"5119334c55d14c41a58b75d288f2b26e-8df22816090447a6","baggage":"sentry-trace_id=5119334c55d14c41a58b75d288f2b26e,sentry-release=Unknown"},"correlation_id":"01M0EW3B4MWT1K6Y8K6KH6YFT0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:28.586Z","job_size_bytes":23,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-4f79ec3c366a2c8c72e2ef57: done: 0.0872 sec","job_status":"done","queue_duration_s":0.832822,"scheduling_latency_s":0.832866,"redis_calls":7,"redis_duration_s":0.002928,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002032,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000896,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.062624,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.0872,"completed_at":"2026-08-20T06:00:29.506Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016766,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2303gitlab # [ 442.759304] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:29.509Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"9bf9a53516d34dc5f47ebd2f","created_at":"2026-08-20T06:00:28.604Z","trace_propagation_headers":{"sentry-trace":"b62c6e4ff3bc444780fae483c7cd16d9-47984093f8a04ffc","baggage":"sentry-trace_id=b62c6e4ff3bc444780fae483c7cd16d9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW3CADET86A0A4AZ1E2Q21","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:28.609Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-9bf9a53516d34dc5f47ebd2f: start","job_status":"start","queue_duration_s":0.90014,"scheduling_latency_s":0.900179}2304gitlab # [ 442.840750] gitaly[891]: time="2026-08-20T06:00:29.633Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW3CADET86A0A4AZ1E2Q21 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T06:00:59.230" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:29.631" grpc.time_ms=1.497 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2305gitlab # [ 442.939730] gitaly[891]: time="2026-08-20T06:00:29.731Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3CADET86A0A4AZ1E2Q21 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:00:59.329" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:29.729" grpc.time_ms=1.697 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2306gitlab # [ 442.977851] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:29.763Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"9bf9a53516d34dc5f47ebd2f","created_at":"2026-08-20T06:00:28.604Z","trace_propagation_headers":{"sentry-trace":"b62c6e4ff3bc444780fae483c7cd16d9-47984093f8a04ffc","baggage":"sentry-trace_id=b62c6e4ff3bc444780fae483c7cd16d9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW3CADET86A0A4AZ1E2Q21","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:28.609Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-9bf9a53516d34dc5f47ebd2f: done: 0.253628 sec","job_status":"done","queue_duration_s":0.90014,"scheduling_latency_s":0.900179,"gitaly_calls":2,"gitaly_duration_s":0.013424,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.012734,"redis_read_bytes":80,"redis_write_bytes":5121,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001602,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.002513,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000474,"redis_queues_read_bytes":3,"redis_queues_write_bytes":1132,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002856,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000419,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.001019,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002249,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.044,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.004,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.007,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.02,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.194191,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.19040318,"duration_s":0.253628,"completed_at":"2026-08-20T06:00:29.762Z","load_balancing_strategy":"primary","db_duration_s":0.04685,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2307gitlab # [ 443.058869] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:29.767Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"ed0b808173ef24718186d08c","created_at":"2026-08-20T06:00:28.740Z","trace_propagation_headers":{"sentry-trace":"5119334c55d14c41a58b75d288f2b26e-8df22816090447a6","baggage":"sentry-trace_id=5119334c55d14c41a58b75d288f2b26e,sentry-release=Unknown"},"correlation_id":"01M0EW3B4MWT1K6Y8K6KH6YFT0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:28.744Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-ed0b808173ef24718186d08c: start","job_status":"start","queue_duration_s":1.023099,"scheduling_latency_s":1.023152}2308gitlab # [ 443.076435] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:29.863Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"ed0b808173ef24718186d08c","created_at":"2026-08-20T06:00:28.740Z","trace_propagation_headers":{"sentry-trace":"5119334c55d14c41a58b75d288f2b26e-8df22816090447a6","baggage":"sentry-trace_id=5119334c55d14c41a58b75d288f2b26e,sentry-release=Unknown"},"correlation_id":"01M0EW3B4MWT1K6Y8K6KH6YFT0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:28.744Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-ed0b808173ef24718186d08c: done: 0.096649 sec","job_status":"done","queue_duration_s":1.023099,"scheduling_latency_s":1.023152,"redis_calls":7,"redis_duration_s":0.006923,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00557,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001353,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.019,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.05595,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.096649,"completed_at":"2026-08-20T06:00:29.863Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018543,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2309gitlab # [ 443.120090] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:29.867Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"32ba084ffb862cc277f2ebca","created_at":"2026-08-20T06:00:28.752Z","trace_propagation_headers":{"sentry-trace":"5119334c55d14c41a58b75d288f2b26e-8df22816090447a6","baggage":"sentry-trace_id=5119334c55d14c41a58b75d288f2b26e,sentry-release=Unknown"},"correlation_id":"01M0EW3B4MWT1K6Y8K6KH6YFT0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:28.757Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-32ba084ffb862cc277f2ebca: start","job_status":"start","queue_duration_s":1.110679,"scheduling_latency_s":1.110727}2310gitlab # [ 443.148146] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:29.939Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"32ba084ffb862cc277f2ebca","created_at":"2026-08-20T06:00:28.752Z","trace_propagation_headers":{"sentry-trace":"5119334c55d14c41a58b75d288f2b26e-8df22816090447a6","baggage":"sentry-trace_id=5119334c55d14c41a58b75d288f2b26e,sentry-release=Unknown"},"correlation_id":"01M0EW3B4MWT1K6Y8K6KH6YFT0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:28.757Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-32ba084ffb862cc277f2ebca: done: 0.071935 sec","job_status":"done","queue_duration_s":1.110679,"scheduling_latency_s":1.110727,"redis_calls":7,"redis_duration_s":0.003005,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002172,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000833,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.051301,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.071935,"completed_at":"2026-08-20T06:00:29.939Z","load_balancing_strategy":"primary","db_duration_s":0.010866,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2311gitlab # [ 443.192444] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:29.942Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"992297721aef22101aa9c55e","created_at":"2026-08-20T06:00:28.766Z","trace_propagation_headers":{"sentry-trace":"5119334c55d14c41a58b75d288f2b26e-8df22816090447a6","baggage":"sentry-trace_id=5119334c55d14c41a58b75d288f2b26e,sentry-release=Unknown"},"correlation_id":"01M0EW3B4MWT1K6Y8K6KH6YFT0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:28.768Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-992297721aef22101aa9c55e: start","job_status":"start","queue_duration_s":1.173789,"scheduling_latency_s":1.173821}2312gitlab # [ 443.211289] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:30.002Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"992297721aef22101aa9c55e","created_at":"2026-08-20T06:00:28.766Z","trace_propagation_headers":{"sentry-trace":"5119334c55d14c41a58b75d288f2b26e-8df22816090447a6","baggage":"sentry-trace_id=5119334c55d14c41a58b75d288f2b26e,sentry-release=Unknown"},"correlation_id":"01M0EW3B4MWT1K6Y8K6KH6YFT0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:28.768Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-992297721aef22101aa9c55e: done: 0.059884 sec","job_status":"done","queue_duration_s":1.173789,"scheduling_latency_s":1.173821,"redis_calls":10,"redis_duration_s":0.004811,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001677,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.002381,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000753,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040821,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.059884,"completed_at":"2026-08-20T06:00:30.001Z","load_balancing_strategy":"primary","db_duration_s":0.00992,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2313gitlab # [ 443.256076] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:30.005Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"c31c59c5c8bdc726d4d0ca4d","created_at":"2026-08-20T06:00:28.769Z","trace_propagation_headers":{"sentry-trace":"5119334c55d14c41a58b75d288f2b26e-8df22816090447a6","baggage":"sentry-trace_id=5119334c55d14c41a58b75d288f2b26e,sentry-release=Unknown"},"correlation_id":"01M0EW3B4MWT1K6Y8K6KH6YFT0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:28.771Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-c31c59c5c8bdc726d4d0ca4d: start","job_status":"start","queue_duration_s":1.233731,"scheduling_latency_s":1.23376}2314gitlab # [ 443.272993] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:30.052Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"c31c59c5c8bdc726d4d0ca4d","created_at":"2026-08-20T06:00:28.769Z","trace_propagation_headers":{"sentry-trace":"5119334c55d14c41a58b75d288f2b26e-8df22816090447a6","baggage":"sentry-trace_id=5119334c55d14c41a58b75d288f2b26e,sentry-release=Unknown"},"correlation_id":"01M0EW3B4MWT1K6Y8K6KH6YFT0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:28.771Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-c31c59c5c8bdc726d4d0ca4d: done: 0.046606 sec","job_status":"done","queue_duration_s":1.233731,"scheduling_latency_s":1.23376,"redis_calls":7,"redis_duration_s":0.003278,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002627,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000651,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031853,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.046606,"completed_at":"2026-08-20T06:00:30.052Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008472,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2315gitlab # [ 443.316762] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:30.056Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"3cc53db4cd6f2598c9cd1a6c","created_at":"2026-08-20T06:00:28.772Z","trace_propagation_headers":{"sentry-trace":"5119334c55d14c41a58b75d288f2b26e-8df22816090447a6","baggage":"sentry-trace_id=5119334c55d14c41a58b75d288f2b26e,sentry-release=Unknown"},"correlation_id":"01M0EW3B4MWT1K6Y8K6KH6YFT0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:28.777Z","job_size_bytes":19,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-3cc53db4cd6f2598c9cd1a6c: start","job_status":"start","queue_duration_s":1.278949,"scheduling_latency_s":1.278976}2316gitlab # [ 443.333166] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:30.097Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"3cc53db4cd6f2598c9cd1a6c","created_at":"2026-08-20T06:00:28.772Z","trace_propagation_headers":{"sentry-trace":"5119334c55d14c41a58b75d288f2b26e-8df22816090447a6","baggage":"sentry-trace_id=5119334c55d14c41a58b75d288f2b26e,sentry-release=Unknown"},"correlation_id":"01M0EW3B4MWT1K6Y8K6KH6YFT0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:28.777Z","job_size_bytes":19,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-3cc53db4cd6f2598c9cd1a6c: done: 0.04106 sec","job_status":"done","queue_duration_s":1.278949,"scheduling_latency_s":1.278976,"redis_calls":8,"redis_duration_s":0.0029259999999999998,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00228,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000646,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027047,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.04106,"completed_at":"2026-08-20T06:00:30.097Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006801,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2317gitlab # [ 443.377441] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:30.099Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"73c41a5df676eb5be884cab5","created_at":"2026-08-20T06:00:28.778Z","trace_propagation_headers":{"sentry-trace":"5119334c55d14c41a58b75d288f2b26e-8df22816090447a6","baggage":"sentry-trace_id=5119334c55d14c41a58b75d288f2b26e,sentry-release=Unknown"},"correlation_id":"01M0EW3B4MWT1K6Y8K6KH6YFT0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:28.780Z","job_size_bytes":66,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-73c41a5df676eb5be884cab5: start","job_status":"start","queue_duration_s":1.319054,"scheduling_latency_s":1.31908}2318gitlab # [ 443.395186] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:30.136Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"73c41a5df676eb5be884cab5","created_at":"2026-08-20T06:00:28.778Z","trace_propagation_headers":{"sentry-trace":"5119334c55d14c41a58b75d288f2b26e-8df22816090447a6","baggage":"sentry-trace_id=5119334c55d14c41a58b75d288f2b26e,sentry-release=Unknown"},"correlation_id":"01M0EW3B4MWT1K6Y8K6KH6YFT0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:28.780Z","job_size_bytes":66,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-73c41a5df676eb5be884cab5: done: 0.037105 sec","job_status":"done","queue_duration_s":1.319054,"scheduling_latency_s":1.31908,"redis_calls":7,"redis_duration_s":0.002256,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001612,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000644,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024745,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037105,"completed_at":"2026-08-20T06:00:30.136Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005537,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2319gitlab # [ 443.439726] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:30.139Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"19cbece343945304060e5910","created_at":"2026-08-20T06:00:28.780Z","trace_propagation_headers":{"sentry-trace":"5119334c55d14c41a58b75d288f2b26e-8df22816090447a6","baggage":"sentry-trace_id=5119334c55d14c41a58b75d288f2b26e,sentry-release=Unknown"},"correlation_id":"01M0EW3B4MWT1K6Y8K6KH6YFT0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:28.782Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-19cbece343945304060e5910: start","job_status":"start","queue_duration_s":1.356741,"scheduling_latency_s":1.356766}2320gitlab # [ 443.456336] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:30.179Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"19cbece343945304060e5910","created_at":"2026-08-20T06:00:28.780Z","trace_propagation_headers":{"sentry-trace":"5119334c55d14c41a58b75d288f2b26e-8df22816090447a6","baggage":"sentry-trace_id=5119334c55d14c41a58b75d288f2b26e,sentry-release=Unknown"},"correlation_id":"01M0EW3B4MWT1K6Y8K6KH6YFT0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:28.782Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-19cbece343945304060e5910: done: 0.040269 sec","job_status":"done","queue_duration_s":1.356741,"scheduling_latency_s":1.356766,"redis_calls":7,"redis_duration_s":0.002708,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001766,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000942,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024231,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.040269,"completed_at":"2026-08-20T06:00:30.179Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009349,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2321gitlab # [ 443.499771] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:30.183Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"ee82803a2a92e3a7614b2beb","created_at":"2026-08-20T06:00:28.783Z","trace_propagation_headers":{"sentry-trace":"5119334c55d14c41a58b75d288f2b26e-8df22816090447a6","baggage":"sentry-trace_id=5119334c55d14c41a58b75d288f2b26e,sentry-release=Unknown"},"correlation_id":"01M0EW3B4MWT1K6Y8K6KH6YFT0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:28.785Z","job_size_bytes":6,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-ee82803a2a92e3a7614b2beb: start","job_status":"start","queue_duration_s":1.397252,"scheduling_latency_s":1.397276}2322gitlab # [ 443.516263] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:30.202Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"ee82803a2a92e3a7614b2beb","created_at":"2026-08-20T06:00:28.783Z","trace_propagation_headers":{"sentry-trace":"5119334c55d14c41a58b75d288f2b26e-8df22816090447a6","baggage":"sentry-trace_id=5119334c55d14c41a58b75d288f2b26e,sentry-release=Unknown"},"correlation_id":"01M0EW3B4MWT1K6Y8K6KH6YFT0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:28.785Z","job_size_bytes":6,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-ee82803a2a92e3a7614b2beb: done: 0.019279 sec","job_status":"done","queue_duration_s":1.397252,"scheduling_latency_s":1.397276,"redis_calls":7,"redis_duration_s":0.0018939999999999999,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00137,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000524,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011446,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019279,"completed_at":"2026-08-20T06:00:30.202Z","load_balancing_strategy":"primary","db_duration_s":0.00083,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2323gitlab # [ 443.560179] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:30.203Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"a4525d94c25866d29c05d105","created_at":"2026-08-20T06:00:28.786Z","trace_propagation_headers":{"sentry-trace":"5119334c55d14c41a58b75d288f2b26e-8df22816090447a6","baggage":"sentry-trace_id=5119334c55d14c41a58b75d288f2b26e,sentry-release=Unknown"},"correlation_id":"01M0EW3B4MWT1K6Y8K6KH6YFT0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:28.791Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-a4525d94c25866d29c05d105: start","job_status":"start","queue_duration_s":1.412684,"scheduling_latency_s":1.412703}2324gitlab # [ 443.577337] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:30.314Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"a4525d94c25866d29c05d105","created_at":"2026-08-20T06:00:28.786Z","trace_propagation_headers":{"sentry-trace":"5119334c55d14c41a58b75d288f2b26e-8df22816090447a6","baggage":"sentry-trace_id=5119334c55d14c41a58b75d288f2b26e,sentry-release=Unknown"},"correlation_id":"01M0EW3B4MWT1K6Y8K6KH6YFT0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:28.791Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-a4525d94c25866d29c05d105: done: 0.111057 sec","job_status":"done","queue_duration_s":1.412684,"scheduling_latency_s":1.412703,"redis_calls":7,"redis_duration_s":0.011714,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.007518,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004196,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.054,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.05,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036825,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.111057,"completed_at":"2026-08-20T06:00:30.314Z","load_balancing_strategy":"primary","db_duration_s":0.054272,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2325gitlab # [ 443.619808] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:30.320Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"0222f444cdeb8f9910512400","created_at":"2026-08-20T06:00:28.891Z","trace_propagation_headers":{"sentry-trace":"5119334c55d14c41a58b75d288f2b26e-8df22816090447a6","baggage":"sentry-trace_id=5119334c55d14c41a58b75d288f2b26e,sentry-release=Unknown"},"correlation_id":"01M0EW3B4MWT1K6Y8K6KH6YFT0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:28.895Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-0222f444cdeb8f9910512400: start","job_status":"start","queue_duration_s":1.424754,"scheduling_latency_s":1.424806}2326gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1cdfdcaac5d2032ba64a258aa245ab4017e01fcb/statuses2327gitlab # [ 443.665329] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:30.457Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"0222f444cdeb8f9910512400","created_at":"2026-08-20T06:00:28.891Z","trace_propagation_headers":{"sentry-trace":"5119334c55d14c41a58b75d288f2b26e-8df22816090447a6","baggage":"sentry-trace_id=5119334c55d14c41a58b75d288f2b26e,sentry-release=Unknown"},"correlation_id":"01M0EW3B4MWT1K6Y8K6KH6YFT0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:28.895Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-0222f444cdeb8f9910512400: done: 0.13658 sec","job_status":"done","queue_duration_s":1.424754,"scheduling_latency_s":1.424806,"redis_calls":8,"redis_duration_s":0.010824,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.009402,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001422,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.046,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.042,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.056411,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.13658,"completed_at":"2026-08-20T06:00:30.457Z","load_balancing_strategy":"primary","db_duration_s":0.045581,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2328gitlab # [ 443.763942] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:30.466Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"405873e967111800fbd0f2bf","created_at":"2026-08-20T06:00:29.605Z","trace_propagation_headers":{"sentry-trace":"b62c6e4ff3bc444780fae483c7cd16d9-313adb9ca03547c0","baggage":"sentry-trace_id=b62c6e4ff3bc444780fae483c7cd16d9,sentry-release=Unknown"},"correlation_id":"01M0EW3CADET86A0A4AZ1E2Q21","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:29.609Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-405873e967111800fbd0f2bf: start","job_status":"start","queue_duration_s":0.857465,"scheduling_latency_s":0.857498}2329gitlab # [ 443.849500] gitaly[891]: time="2026-08-20T06:00:30.641Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3EJ3SSQ6NS7GPRT052ZF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:01:00.538" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:30.639" grpc.time_ms=1.346 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2330gitlab # [ 443.899214] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:30.690Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"405873e967111800fbd0f2bf","created_at":"2026-08-20T06:00:29.605Z","trace_propagation_headers":{"sentry-trace":"b62c6e4ff3bc444780fae483c7cd16d9-313adb9ca03547c0","baggage":"sentry-trace_id=b62c6e4ff3bc444780fae483c7cd16d9,sentry-release=Unknown"},"correlation_id":"01M0EW3CADET86A0A4AZ1E2Q21","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:29.609Z","job_size_bytes":3,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-405873e967111800fbd0f2bf: done: 0.224314 sec","job_status":"done","queue_duration_s":0.857465,"scheduling_latency_s":0.857498,"redis_calls":7,"redis_duration_s":0.012816000000000001,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.010618,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002198,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.078,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.049,"db_ci_duration_s":0.029,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.070819,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.224314,"completed_at":"2026-08-20T06:00:30.690Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.081967,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2331gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1cdfdcaac5d2032ba64a258aa245ab4017e01fcb/statuses, in 0.29 seconds)2332gitlab # [ 443.948721] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:30.715Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"24b55658de2ad0ea994ee4be","created_at":"2026-08-20T06:00:30.284Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b94f32856907a102fb3c95891302a518","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.373Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-24b55658de2ad0ea994ee4be: start","job_status":"start","queue_duration_s":0.342211,"scheduling_latency_s":0.342284}2333gitlab # [ 443.964095] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:30 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/1cdfdcaac5d2032ba64a258aa245ab4017e01fcb/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1832334gitlab # [ 444.100123] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:30.891Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"24b55658de2ad0ea994ee4be","created_at":"2026-08-20T06:00:30.284Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b94f32856907a102fb3c95891302a518","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.373Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-24b55658de2ad0ea994ee4be: done: 0.175678 sec","job_status":"done","queue_duration_s":0.342211,"scheduling_latency_s":0.342284,"redis_calls":11,"redis_duration_s":0.02866,"redis_read_bytes":9,"redis_write_bytes":1386,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.009461,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.012411,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.006788,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050246,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.175678,"completed_at":"2026-08-20T06:00:30.891Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003091,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2335gitlab # [ 444.191077] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:30.913Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleDeleteObjectsCronWorker","jid":"95788ad15bec4f02dbc24810","created_at":"2026-08-20T06:00:30.397Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b95c8771c9ab1ce8562631e0d645aa1f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8251d4193fad694e50c4958d17fdca56b6fb205fa6961a4b1ccb7cd497bc09c1","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.427Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleDeleteObjectsCronWorker JID-95788ad15bec4f02dbc24810: start","job_status":"start","queue_duration_s":0.485835,"scheduling_latency_s":0.485895}2336gitlab # [ 444.668880] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:31.459Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleDeleteObjectsCronWorker","jid":"95788ad15bec4f02dbc24810","created_at":"2026-08-20T06:00:30.397Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b95c8771c9ab1ce8562631e0d645aa1f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8251d4193fad694e50c4958d17fdca56b6fb205fa6961a4b1ccb7cd497bc09c1","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.427Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleDeleteObjectsCronWorker JID-95788ad15bec4f02dbc24810: done: 0.546229 sec","job_status":"done","queue_duration_s":0.485835,"scheduling_latency_s":0.485895,"redis_calls":65,"redis_duration_s":0.163089,"redis_read_bytes":114,"redis_write_bytes":41232,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.008788,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":656,"redis_queues_calls":2,"redis_queues_duration_s":0.001866,"redis_queues_read_bytes":3,"redis_queues_write_bytes":36935,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.143347,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3374,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.009088,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":267,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.263914,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00467988,"duration_s":0.546229,"completed_at":"2026-08-20T06:00:31.459Z","load_balancing_strategy":"primary","db_duration_s":0.004882,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2337gitlab # [ 444.763957] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:31.471Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"451d8381c0cad8fbfc699db2","created_at":"2026-08-20T06:00:30.445Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"efbb78f095b95e1c4721408dff4d7726","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T06:00:30.464Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-451d8381c0cad8fbfc699db2: start","job_status":"start","queue_duration_s":1.006891,"scheduling_latency_s":1.006951}2338gitlab # [ 444.861372] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:31.652Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"451d8381c0cad8fbfc699db2","created_at":"2026-08-20T06:00:30.445Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"efbb78f095b95e1c4721408dff4d7726","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T06:00:30.464Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-451d8381c0cad8fbfc699db2: done: 0.18091 sec","job_status":"done","queue_duration_s":1.006891,"scheduling_latency_s":1.006951,"redis_calls":9,"redis_duration_s":0.018407,"redis_read_bytes":7,"redis_write_bytes":1068,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.006358,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.009379,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00267,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.057414,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.18091,"completed_at":"2026-08-20T06:00:31.652Z","load_balancing_strategy":"primary","db_duration_s":0.010602,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2339gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1cdfdcaac5d2032ba64a258aa245ab4017e01fcb/statuses2340gitlab # [ 444.949529] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:31.663Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckCiJobsWorker","jid":"a98fb790f28cbc1dab4d9922","created_at":"2026-08-20T06:00:30.487Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1e1c10f4287b4ad97a25be4d8c2b4d5d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:688518068b75df5544ce76496372eb2176b68f67fc20ec19a768c0a774774cd9","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.504Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckCiJobsWorker JID-a98fb790f28cbc1dab4d9922: start","job_status":"start","queue_duration_s":1.159329,"scheduling_latency_s":1.159392}2341gitlab # [ 445.099326] gitaly[891]: time="2026-08-20T06:00:31.890Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3FT0GH3Y6GMJ7CSKWWSE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:01:01.287" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:31.888" grpc.time_ms=1.189 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2342gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1cdfdcaac5d2032ba64a258aa245ab4017e01fcb/statuses, in 0.21 seconds)2343gitlab # [ 445.158840] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:31 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/1cdfdcaac5d2032ba64a258aa245ab4017e01fcb/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1402344gitlab # [ 445.190352] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:31.981Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckCiJobsWorker","jid":"a98fb790f28cbc1dab4d9922","created_at":"2026-08-20T06:00:30.487Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1e1c10f4287b4ad97a25be4d8c2b4d5d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:688518068b75df5544ce76496372eb2176b68f67fc20ec19a768c0a774774cd9","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.504Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckCiJobsWorker JID-a98fb790f28cbc1dab4d9922: done: 0.31796 sec","job_status":"done","queue_duration_s":1.159329,"scheduling_latency_s":1.159392,"redis_calls":21,"redis_duration_s":0.072627,"redis_read_bytes":20,"redis_write_bytes":4658,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.05056,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1380,"redis_queues_calls":3,"redis_queues_duration_s":0.008297,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2315,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006829,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":502,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.006941,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":461,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.057,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.037,"db_ci_duration_s":0.021,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.103554,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.07134662,"duration_s":0.31796,"completed_at":"2026-08-20T06:00:31.981Z","load_balancing_strategy":"primary","db_duration_s":0.077388,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2345gitlab # [ 445.282458] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:31.987Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::Cleanup::DeleteOrphanedDependenciesWorker","jid":"126acc1b1c9cb24b72c558fc","created_at":"2026-08-20T06:00:30.533Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8ec2ffa320043ca89518fb10fe056291","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ae1976bd21c961bb04f5dedb6e2b63c4b50acd9c52a47e7573ade27e3c65ce36","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.546Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::Cleanup::DeleteOrphanedDependenciesWorker JID-126acc1b1c9cb24b72c558fc: start","job_status":"start","queue_duration_s":1.441464,"scheduling_latency_s":1.441516}2346gitlab # [ 445.498531] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:32.287Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::Cleanup::DeleteOrphanedDependenciesWorker","jid":"126acc1b1c9cb24b72c558fc","created_at":"2026-08-20T06:00:30.533Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8ec2ffa320043ca89518fb10fe056291","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ae1976bd21c961bb04f5dedb6e2b63c4b50acd9c52a47e7573ade27e3c65ce36","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.546Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::Cleanup::DeleteOrphanedDependenciesWorker JID-126acc1b1c9cb24b72c558fc: done: 0.299818 sec","job_status":"done","queue_duration_s":1.441464,"scheduling_latency_s":1.441516,"redis_calls":13,"redis_duration_s":0.016843999999999998,"redis_read_bytes":10,"redis_write_bytes":1343,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002648,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":345,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005232,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.008964,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":368,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.168,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.168,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.051768,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00137298,"extra.packages_cleanup_delete_orphaned_dependencies_worker.last_processed_packages_dependency_id":0,"extra.packages_cleanup_delete_orphaned_dependencies_worker.deleted_rows_count":0,"duration_s":0.299818,"completed_at":"2026-08-20T06:00:32.287Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.179468,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2347gitlab # [ 445.602946] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:32.296Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"4921e28b2897ae1a962a947b","created_at":"2026-08-20T06:00:30.553Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"40200377bc3476b1fdfd03027308c311","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T06:00:30.566Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-4921e28b2897ae1a962a947b: start","job_status":"start","queue_duration_s":1.730664,"scheduling_latency_s":1.730717}2348gitlab # [ 445.620204] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:32.367Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}2349gitlab # [ 445.645660] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:32.436Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"4921e28b2897ae1a962a947b","created_at":"2026-08-20T06:00:30.553Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"40200377bc3476b1fdfd03027308c311","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T06:00:30.566Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-4921e28b2897ae1a962a947b: done: 0.139857 sec","job_status":"done","queue_duration_s":1.730664,"scheduling_latency_s":1.730717,"redis_calls":9,"redis_duration_s":0.016358,"redis_read_bytes":7,"redis_write_bytes":1152,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002238,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.010328,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003792,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037298,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.139857,"completed_at":"2026-08-20T06:00:32.436Z","load_balancing_strategy":"primary","db_duration_s":0.011366,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2350gitlab # [ 445.714408] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:32.447Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckMergeJobsWorker","jid":"92f7ae9d7ebd4e102fd3960c","created_at":"2026-08-20T06:00:30.572Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"70e6d5576e0b87c729c12de35e4a8c88","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:ce304458c2d63d5d84855b65f51692704db52bf763a718b10c08a2bd5f588f06","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.586Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckMergeJobsWorker JID-92f7ae9d7ebd4e102fd3960c: start","job_status":"start","queue_duration_s":1.860442,"scheduling_latency_s":1.860503}2351gitlab # [ 445.769380] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:32.559Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckMergeJobsWorker","jid":"92f7ae9d7ebd4e102fd3960c","created_at":"2026-08-20T06:00:30.572Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"70e6d5576e0b87c729c12de35e4a8c88","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:ce304458c2d63d5d84855b65f51692704db52bf763a718b10c08a2bd5f588f06","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.586Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckMergeJobsWorker JID-92f7ae9d7ebd4e102fd3960c: done: 0.112398 sec","job_status":"done","queue_duration_s":1.860442,"scheduling_latency_s":1.860503,"redis_calls":11,"redis_duration_s":0.025668,"redis_read_bytes":10,"redis_write_bytes":1022,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002699,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":283,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.014719,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00825,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":225,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034737,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00326184,"duration_s":0.112398,"completed_at":"2026-08-20T06:00:32.559Z","load_balancing_strategy":"primary","db_duration_s":0.005532,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2352gitlab # [ 445.841821] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:32.575Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PruneOldEventsWorker","jid":"5e50caf9eb1d283b08b30958","created_at":"2026-08-20T06:00:30.602Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"197f846cf03de69d4f17c03de71b87d9","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:aa7847a0e96d8dccea25d7c51fc9fba0c73a3fc691400b9310229c28e3c4fab3","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.640Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"PruneOldEventsWorker JID-5e50caf9eb1d283b08b30958: start","job_status":"start","queue_duration_s":1.935156,"scheduling_latency_s":1.93522}2353gitlab # [ 445.877527] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:32.668Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PruneOldEventsWorker","jid":"5e50caf9eb1d283b08b30958","created_at":"2026-08-20T06:00:30.602Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"197f846cf03de69d4f17c03de71b87d9","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:aa7847a0e96d8dccea25d7c51fc9fba0c73a3fc691400b9310229c28e3c4fab3","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.640Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"PruneOldEventsWorker JID-5e50caf9eb1d283b08b30958: done: 0.092972 sec","job_status":"done","queue_duration_s":1.935156,"scheduling_latency_s":1.93522,"redis_calls":10,"redis_duration_s":0.006182,"redis_read_bytes":9,"redis_write_bytes":987,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001202,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":283,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003708,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001272,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043611,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00117362,"duration_s":0.092972,"completed_at":"2026-08-20T06:00:32.668Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00405,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2354gitlab # [ 445.944122] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:32.672Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"03860e827919aaa6d1e8342e","created_at":"2026-08-20T06:00:30.660Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"08b0ec0e0fd4dad846e0e3ba24987a67","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.688Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-03860e827919aaa6d1e8342e: start","job_status":"start","queue_duration_s":1.984182,"scheduling_latency_s":1.984228}2355gitlab # [ 445.958675] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:32.716Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"03860e827919aaa6d1e8342e","created_at":"2026-08-20T06:00:30.660Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"08b0ec0e0fd4dad846e0e3ba24987a67","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.688Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-03860e827919aaa6d1e8342e: done: 0.043913 sec","job_status":"done","queue_duration_s":1.984182,"scheduling_latency_s":1.984228,"redis_calls":11,"redis_duration_s":0.004241,"redis_read_bytes":8,"redis_write_bytes":1094,"redis_cache_calls":2,"redis_cache_duration_s":0.000857,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000881,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001751,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":482,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000752,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024523,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.043913,"completed_at":"2026-08-20T06:00:32.715Z","load_balancing_strategy":"primary","db_duration_s":0.001194,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2356gitlab # [ 446.000755] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:32.718Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"fd9ce3e2a9e1d68fbdd16eea","created_at":"2026-08-20T06:00:30.701Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0cff89e233cb8b51ababb93894ecf06c","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.729Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-fd9ce3e2a9e1d68fbdd16eea: start","job_status":"start","queue_duration_s":1.988675,"scheduling_latency_s":1.988714}2357gitlab # [ 446.015000] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:32.758Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"fd9ce3e2a9e1d68fbdd16eea","created_at":"2026-08-20T06:00:30.701Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0cff89e233cb8b51ababb93894ecf06c","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.729Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-fd9ce3e2a9e1d68fbdd16eea: done: 0.039951 sec","job_status":"done","queue_duration_s":1.988675,"scheduling_latency_s":1.988714,"redis_calls":11,"redis_duration_s":0.003856,"redis_read_bytes":9,"redis_write_bytes":1418,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000679,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001596,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001581,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023205,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00089956,"exclusive_lock_hold_duration_s":0.00521902,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.039951,"completed_at":"2026-08-20T06:00:32.758Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003255,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2358gitlab # [ 446.058082] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:32.761Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["[FILTERED]"],"class":"Database::BackgroundOperation::CronEnqueueWorker","jid":"a4cb159114996626bb83527a","created_at":"2026-08-20T06:00:30.752Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2d0a70e8093a8ba9a823d74bba191599","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:38f97efb1ac6a87ded5913833f7d951478e91a6be2a4328abbe154ee188cf7fb","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.769Z","job_size_bytes":101,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CronEnqueueWorker JID-a4cb159114996626bb83527a: start","job_status":"start","queue_duration_s":1.991479,"scheduling_latency_s":1.991515}2359gitlab # [ 446.073664] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:32.854Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["[FILTERED]"],"class":"Database::BackgroundOperation::CronEnqueueWorker","jid":"a4cb159114996626bb83527a","created_at":"2026-08-20T06:00:30.752Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2d0a70e8093a8ba9a823d74bba191599","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:38f97efb1ac6a87ded5913833f7d951478e91a6be2a4328abbe154ee188cf7fb","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.769Z","job_size_bytes":101,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CronEnqueueWorker JID-a4cb159114996626bb83527a: done: 0.093757 sec","job_status":"done","queue_duration_s":1.991479,"scheduling_latency_s":1.991515,"redis_calls":10,"redis_duration_s":0.003389,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000723,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001958,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000708,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.057414,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0005628,"duration_s":0.093757,"completed_at":"2026-08-20T06:00:32.854Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.024062,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2360gitlab # [ 446.115976] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:32.857Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"101df942a58038c2f5d2f0b8","created_at":"2026-08-20T06:00:30.779Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"97e7ccbcfd6adcef89a75430508cfd09","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.816Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-101df942a58038c2f5d2f0b8: start","job_status":"start","queue_duration_s":2.04104,"scheduling_latency_s":2.04107}2361gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1cdfdcaac5d2032ba64a258aa245ab4017e01fcb/statuses2362gitlab # [ 446.321649] gitaly[891]: time="2026-08-20T06:00:33.112Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3H02YQQ221NGE1TZPPE0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:01:03.009" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:33.110" grpc.time_ms=1.24 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2363gitlab # [ 446.369816] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:33 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/1cdfdcaac5d2032ba64a258aa245ab4017e01fcb/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1332364gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1cdfdcaac5d2032ba64a258aa245ab4017e01fcb/statuses, in 0.21 seconds)2365gitlab # [ 446.594605] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:33.386Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"101df942a58038c2f5d2f0b8","created_at":"2026-08-20T06:00:30.779Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"97e7ccbcfd6adcef89a75430508cfd09","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.816Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-101df942a58038c2f5d2f0b8: done: 0.528852 sec","job_status":"done","queue_duration_s":2.04104,"scheduling_latency_s":2.04107,"redis_calls":564,"redis_duration_s":0.12782900000000003,"redis_read_bytes":562,"redis_write_bytes":49063,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000595,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001388,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.125846,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.456494,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.528852,"completed_at":"2026-08-20T06:00:33.386Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000877,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2366gitlab # [ 446.690260] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:33.388Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","jid":"d08eea924d3465e4142ae75a","created_at":"2026-08-20T06:00:30.853Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9d9f5ec3b86cbbafd0a3c8a44fa3cf6e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6fd978bae1387dafc89025ea66dbcf41624e32b5e06562317011e023b1327155","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.883Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleBulkDeleteJobArtifactCronWorker JID-d08eea924d3465e4142ae75a: start","job_status":"start","queue_duration_s":2.50444,"scheduling_latency_s":2.504468}2367gitlab # [ 446.712490] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:33.429Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","jid":"d08eea924d3465e4142ae75a","created_at":"2026-08-20T06:00:30.853Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9d9f5ec3b86cbbafd0a3c8a44fa3cf6e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6fd978bae1387dafc89025ea66dbcf41624e32b5e06562317011e023b1327155","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.883Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleBulkDeleteJobArtifactCronWorker JID-d08eea924d3465e4142ae75a: done: 0.040942 sec","job_status":"done","queue_duration_s":2.50444,"scheduling_latency_s":2.504468,"redis_calls":24,"redis_duration_s":0.005874,"redis_read_bytes":25,"redis_write_bytes":5977,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001059,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":704,"redis_queues_calls":2,"redis_queues_duration_s":0.000435,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3810,"redis_queues_metadata_calls":11,"redis_queues_metadata_duration_s":0.002737,"redis_queues_metadata_read_bytes":14,"redis_queues_metadata_write_bytes":894,"redis_shared_state_calls":7,"redis_shared_state_duration_s":0.001643,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":569,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02837,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034258,"extra.ci_schedule_bulk_delete_job_artifact_cron_worker.max_buckets":5,"extra.ci_schedule_bulk_delete_job_artifact_cron_worker.available_count":0,"extra.ci_schedule_bulk_delete_job_artifact_cron_worker.occupied_count":0,"extra.ci_schedule_bulk_delete_job_artifact_cron_worker.stale_count":0,"extra.ci_schedule_bulk_delete_job_artifact_cron_worker.missing_count":5,"duration_s":0.040942,"completed_at":"2026-08-20T06:00:33.429Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001567,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2368gitlab # [ 446.768480] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:33.430Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"375160aa88ac052c55885eb6","created_at":"2026-08-20T06:00:30.906Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1104684ea618cee1000cf2500c05985b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.923Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-375160aa88ac052c55885eb6: start","job_status":"start","queue_duration_s":2.507283,"scheduling_latency_s":2.507304}2369gitlab # [ 446.957831] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:33.748Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"375160aa88ac052c55885eb6","created_at":"2026-08-20T06:00:30.906Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1104684ea618cee1000cf2500c05985b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.923Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-375160aa88ac052c55885eb6: done: 0.317449 sec","job_status":"done","queue_duration_s":2.507283,"scheduling_latency_s":2.507304,"redis_calls":13,"redis_duration_s":0.003598,"redis_read_bytes":11,"redis_write_bytes":1567,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000898,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001409,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001291,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.055,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.055,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.237841,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00062748,"exclusive_lock_hold_duration_s":0.28817084,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.317449,"completed_at":"2026-08-20T06:00:33.748Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.087494,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2370gitlab # [ 447.052983] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:33.751Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"652f1b95981d0411d9b001cb","created_at":"2026-08-20T06:00:30.939Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c6cec0ff298875d5f8d75bc3176713ec","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.963Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-652f1b95981d0411d9b001cb: start","job_status":"start","queue_duration_s":2.788202,"scheduling_latency_s":2.788242}2371gitlab # [ 447.070425] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:33.795Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"652f1b95981d0411d9b001cb","created_at":"2026-08-20T06:00:30.939Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c6cec0ff298875d5f8d75bc3176713ec","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.963Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-652f1b95981d0411d9b001cb: done: 0.044428 sec","job_status":"done","queue_duration_s":2.788202,"scheduling_latency_s":2.788242,"redis_calls":11,"redis_duration_s":0.004428,"redis_read_bytes":9,"redis_write_bytes":1174,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000908,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002183,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000546,"redis_rate_limiting_write_bytes":51,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000791,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02792,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00055428,"extra.cells_stale_requests_cleanup_cron_worker.removed_count":0,"duration_s":0.044428,"completed_at":"2026-08-20T06:00:33.795Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000817,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2372gitlab # [ 447.117359] gitaly[891]: time="2026-08-20T06:00:33.796Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3HN19SG0N5SKPPF1GA0A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:01:03.194" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:33.795" grpc.time_ms=1.031 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2373gitlab # [ 447.130269] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:33.798Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"9c5385d9b6fa62da547df7e7","created_at":"2026-08-20T06:00:30.987Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"633504c85bffb82b921550ccf2a57b8a","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.015Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-9c5385d9b6fa62da547df7e7: start","job_status":"start","queue_duration_s":2.783005,"scheduling_latency_s":2.783043}2374gitlab # [ 447.144968] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:33.836Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"9c5385d9b6fa62da547df7e7","created_at":"2026-08-20T06:00:30.987Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"633504c85bffb82b921550ccf2a57b8a","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.015Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-9c5385d9b6fa62da547df7e7: done: 0.037892 sec","job_status":"done","queue_duration_s":2.783005,"scheduling_latency_s":2.783043,"redis_calls":9,"redis_duration_s":0.002466,"redis_read_bytes":7,"redis_write_bytes":984,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000475,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001428,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000563,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02295,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037892,"completed_at":"2026-08-20T06:00:33.836Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003625,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2375gitlab # [ 447.187369] gitaly[891]: time="2026-08-20T06:00:33.878Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=5 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW3HN19SG0N5SKPPF1GA0A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:00:43.090" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:33.861" grpc.time_ms=17.116 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2376gitlab # [ 447.201343] nixbot[3574]: {"ts": "2026-08-20T06:00:33.954Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1cdfdcaac5d2032ba64a258aa245ab4017e01fcb \"HTTP/1.1 201 Created\""}2377gitlab # [ 447.204115] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:33 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 2542378gitlab # [ 447.206743] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:33.845Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"736a1c7af5738476a7129415","created_at":"2026-08-20T06:00:31.048Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"48e8b3748c32fa8cdbbeab8e66f60819","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.071Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-736a1c7af5738476a7129415: start","job_status":"start","queue_duration_s":2.773866,"scheduling_latency_s":2.773911}2379gitlab # [ 447.221630] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:33.929Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"736a1c7af5738476a7129415","created_at":"2026-08-20T06:00:31.048Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"48e8b3748c32fa8cdbbeab8e66f60819","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.071Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-736a1c7af5738476a7129415: done: 0.084576 sec","job_status":"done","queue_duration_s":2.773866,"scheduling_latency_s":2.773911,"redis_calls":28,"redis_duration_s":0.010044,"redis_read_bytes":36,"redis_write_bytes":10593,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001657,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":680,"redis_queues_calls":2,"redis_queues_duration_s":0.000683,"redis_queues_read_bytes":3,"redis_queues_write_bytes":8305,"redis_queues_metadata_calls":16,"redis_queues_metadata_duration_s":0.005542,"redis_queues_metadata_read_bytes":24,"redis_queues_metadata_write_bytes":1162,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002162,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":446,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.063256,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003722,"duration_s":0.084576,"completed_at":"2026-08-20T06:00:33.929Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002662,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2380gitlab # [ 447.266035] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:33.931Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"c2244113bb251ac6b0f6811f","created_at":"2026-08-20T06:00:31.093Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3336cfd4e8d72d8fc21ab01220319c23","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.118Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-c2244113bb251ac6b0f6811f: start","job_status":"start","queue_duration_s":2.813392,"scheduling_latency_s":2.813423}2381gitlab # [ 447.281094] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.003Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"c2244113bb251ac6b0f6811f","created_at":"2026-08-20T06:00:31.093Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3336cfd4e8d72d8fc21ab01220319c23","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.118Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-c2244113bb251ac6b0f6811f: done: 0.071886 sec","job_status":"done","queue_duration_s":2.813392,"scheduling_latency_s":2.813423,"redis_calls":11,"redis_duration_s":0.0024210000000000004,"redis_read_bytes":9,"redis_write_bytes":1518,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00034,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.0011,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000981,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.029,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03219,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00078872,"exclusive_lock_hold_duration_s":0.02782126,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.071886,"completed_at":"2026-08-20T06:00:34.003Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.030303,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2382gitlab # [ 447.328223] gitaly[891]: time="2026-08-20T06:00:34.045Z" level=info msg="finished unary call with code OK" catfile.duration_ms=4 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=4 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3HXJFTF8TV3ZE1CDBQ3N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:01:04.039" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:34.040" grpc.time_ms=5.378 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2383gitlab # [ 447.341193] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.005Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"d92ad8787a2c6f278b6a3343","created_at":"2026-08-20T06:00:31.139Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8b0fc62e584273e6c767a459056cefca","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.166Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-d92ad8787a2c6f278b6a3343: start","job_status":"start","queue_duration_s":2.839161,"scheduling_latency_s":2.83919}2384gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1cdfdcaac5d2032ba64a258aa245ab4017e01fcb/statuses2385gitlab # [ 447.355979] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.089Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"d92ad8787a2c6f278b6a3343","created_at":"2026-08-20T06:00:31.139Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8b0fc62e584273e6c767a459056cefca","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.166Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-d92ad8787a2c6f278b6a3343: done: 0.083572 sec","job_status":"done","queue_duration_s":2.839161,"scheduling_latency_s":2.83919,"redis_calls":13,"redis_duration_s":0.003188,"redis_read_bytes":11,"redis_write_bytes":1780,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000708,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001389,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001091,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.028,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042385,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00070182,"exclusive_lock_hold_duration_s":0.0489821,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.083572,"completed_at":"2026-08-20T06:00:34.089Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.031825,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2386gitlab # [ 447.399417] gitaly[891]: time="2026-08-20T06:00:34.110Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=3 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW3HXJFTF8TV3ZE1CDBQ3N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:00:44.087" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:34.097" grpc.time_ms=12.659 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2387gitlab # [ 447.417632] nixbot[3574]: {"ts": "2026-08-20T06:00:34.181Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1cdfdcaac5d2032ba64a258aa245ab4017e01fcb \"HTTP/1.1 201 Created\""}2388gitlab # [ 447.422143] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:34 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2072389gitlab # [ 447.425661] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.091Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"54755874850a279aa011ab5e","created_at":"2026-08-20T06:00:31.190Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7b4d08916874fac0b532ee034db0c0cb","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.220Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-54755874850a279aa011ab5e: start","job_status":"start","queue_duration_s":2.871605,"scheduling_latency_s":2.871633}2390gitlab # [ 447.444177] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.135Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"54755874850a279aa011ab5e","created_at":"2026-08-20T06:00:31.190Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7b4d08916874fac0b532ee034db0c0cb","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.220Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-54755874850a279aa011ab5e: done: 0.043699 sec","job_status":"done","queue_duration_s":2.871605,"scheduling_latency_s":2.871633,"redis_calls":9,"redis_duration_s":0.002809,"redis_read_bytes":7,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00051,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001597,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000702,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02771,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.043699,"completed_at":"2026-08-20T06:00:34.135Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004766,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2391gitlab # [ 447.488922] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.137Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"752585dd2414a1eff4fc8c6a","created_at":"2026-08-20T06:00:31.242Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3714af77fc04a7ccf15c4df61855c46f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.268Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-752585dd2414a1eff4fc8c6a: start","job_status":"start","queue_duration_s":2.869365,"scheduling_latency_s":2.86939}2392gitlab # [ 447.503914] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.154Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}2393gitlab # [ 447.508860] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.164Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"752585dd2414a1eff4fc8c6a","created_at":"2026-08-20T06:00:31.242Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3714af77fc04a7ccf15c4df61855c46f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.268Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-752585dd2414a1eff4fc8c6a: done: 0.026547 sec","job_status":"done","queue_duration_s":2.869365,"scheduling_latency_s":2.86939,"redis_calls":9,"redis_duration_s":0.0025009999999999998,"redis_read_bytes":7,"redis_write_bytes":1185,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000442,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001483,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000576,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016035,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026547,"completed_at":"2026-08-20T06:00:34.164Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000875,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2394gitlab # [ 447.553057] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.165Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"68a8a8461535d58a348d0b4d","created_at":"2026-08-20T06:00:31.295Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6e125e0abf80a49fd1a921785b4c7450","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.320Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-68a8a8461535d58a348d0b4d: start","job_status":"start","queue_duration_s":2.845049,"scheduling_latency_s":2.84507}2395gitlab # [ 447.567189] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.219Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"68a8a8461535d58a348d0b4d","created_at":"2026-08-20T06:00:31.295Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6e125e0abf80a49fd1a921785b4c7450","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.320Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-68a8a8461535d58a348d0b4d: done: 0.053857 sec","job_status":"done","queue_duration_s":2.845049,"scheduling_latency_s":2.84507,"redis_calls":9,"redis_duration_s":0.002358,"redis_read_bytes":7,"redis_write_bytes":1183,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000514,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001335,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000509,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022302,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.053857,"completed_at":"2026-08-20T06:00:34.219Z","load_balancing_strategy":"primary","db_duration_s":0.021667,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2396gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1cdfdcaac5d2032ba64a258aa245ab4017e01fcb/statuses, in 0.24 seconds)2397gitlab # [ 447.611075] gitaly[891]: time="2026-08-20T06:00:34.301Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3J4RWMS4EH5MW48H34CB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:01:04.198" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:34.298" grpc.time_ms=2.354 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2398gitlab # [ 447.623449] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:34 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/1cdfdcaac5d2032ba64a258aa245ab4017e01fcb/statuses HTTP/1.1" 200 1307 "" "curl/8.21.0" 1492399gitlab # [ 447.626192] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.221Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"f47ab0a17feb8f26c15cc765","created_at":"2026-08-20T06:00:31.342Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5c2c0372ad0e25bad93417372c53d55d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.367Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-f47ab0a17feb8f26c15cc765: start","job_status":"start","queue_duration_s":2.853813,"scheduling_latency_s":2.853839}2400gitlab # [ 447.641410] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.248Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"f47ab0a17feb8f26c15cc765","created_at":"2026-08-20T06:00:31.342Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5c2c0372ad0e25bad93417372c53d55d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.367Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-f47ab0a17feb8f26c15cc765: done: 0.027231 sec","job_status":"done","queue_duration_s":2.853813,"scheduling_latency_s":2.853839,"redis_calls":9,"redis_duration_s":0.001899,"redis_read_bytes":7,"redis_write_bytes":1192,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000353,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000796,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00075,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015892,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027231,"completed_at":"2026-08-20T06:00:34.248Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000499,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2401gitlab # [ 447.684935] gitaly[891]: time="2026-08-20T06:00:34.342Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3J5X3GXTY0HNVS2TX2ZP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:01:04.340" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:34.341" grpc.time_ms=0.707 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2402gitlab # [ 447.698001] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:34 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1cdfdcaac5d2032ba64a258aa245ab4017e01fcb HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2232403gitlab # [ 447.700585] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.250Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"RepositoryArchiveCacheWorker","jid":"0fcfdf7820715745d18087fe","created_at":"2026-08-20T06:00:31.390Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f01c60f5dabb84c8be93a36fc9a8fe95","meta.root_caller_id":"Cronjob","meta.feature_category":"source_code_management","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:e95d964ef170969342a5c9d45a52aad8532569d2d839f18acfd130ccc124369d","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.415Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"RepositoryArchiveCacheWorker JID-0fcfdf7820715745d18087fe: start","job_status":"start","queue_duration_s":2.834826,"scheduling_latency_s":2.834848}2404gitlab # [ 447.714956] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.279Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"RepositoryArchiveCacheWorker","jid":"0fcfdf7820715745d18087fe","created_at":"2026-08-20T06:00:31.390Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-9961b4d3a7ca41c3","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f01c60f5dabb84c8be93a36fc9a8fe95","meta.root_caller_id":"Cronjob","meta.feature_category":"source_code_management","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:e95d964ef170969342a5c9d45a52aad8532569d2d839f18acfd130ccc124369d","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.415Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"RepositoryArchiveCacheWorker JID-0fcfdf7820715745d18087fe: done: 0.028973 sec","job_status":"done","queue_duration_s":2.834826,"scheduling_latency_s":2.834848,"redis_calls":12,"redis_duration_s":0.001894,"redis_read_bytes":11,"redis_write_bytes":1392,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000718,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":640,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000849,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000327,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":206,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018917,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025774,"duration_s":0.028973,"completed_at":"2026-08-20T06:00:34.279Z","load_balancing_strategy":"primary","db_duration_s":0.000916,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2405gitlab # [ 447.757080] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.280Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"16d6d54e932cda12d14643d6","created_at":"2026-08-20T06:00:30.994Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-b7460241d2e54a74","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b95c8771c9ab1ce8562631e0d645aa1f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.420Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-16d6d54e932cda12d14643d6: start","job_status":"start","queue_duration_s":2.859817,"scheduling_latency_s":2.859836}2406gitlab # [ 447.769552] nixbot[3574]: {"ts": "2026-08-20T06:00:34.421Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1cdfdcaac5d2032ba64a258aa245ab4017e01fcb \"HTTP/1.1 201 Created\""}2407gitlab # [ 447.772283] gitaly[891]: time="2026-08-20T06:00:34.364Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=6 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0EW3J4RWMS4EH5MW48H34CB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:00:44.263" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:34.353" grpc.time_ms=11.247 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2408gitlab # [ 447.785469] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.323Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"16d6d54e932cda12d14643d6","created_at":"2026-08-20T06:00:30.994Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-b7460241d2e54a74","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b95c8771c9ab1ce8562631e0d645aa1f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.420Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-16d6d54e932cda12d14643d6: done: 0.04274 sec","job_status":"done","queue_duration_s":2.859817,"scheduling_latency_s":2.859836,"redis_calls":13,"redis_duration_s":0.0021479999999999997,"redis_read_bytes":12,"redis_write_bytes":1300,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000282,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":289,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000677,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":395,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001189,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":616,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.009,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.009,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024807,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002517,"duration_s":0.04274,"completed_at":"2026-08-20T06:00:34.323Z","load_balancing_strategy":"primary","db_duration_s":0.011044,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2409gitlab # [ 447.825894] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.325Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"606ee41140535f15f5728e0c","created_at":"2026-08-20T06:00:30.994Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-b7460241d2e54a74","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b95c8771c9ab1ce8562631e0d645aa1f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.420Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-606ee41140535f15f5728e0c: start","job_status":"start","queue_duration_s":2.904469,"scheduling_latency_s":2.904488}2410gitlab # [ 447.838524] nix-daemon[3796]: accepted connection from pid 4561, user nixbot2411gitlab # [ 447.839489] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.354Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"606ee41140535f15f5728e0c","created_at":"2026-08-20T06:00:30.994Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-b7460241d2e54a74","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b95c8771c9ab1ce8562631e0d645aa1f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.420Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-606ee41140535f15f5728e0c: done: 0.029417 sec","job_status":"done","queue_duration_s":2.904469,"scheduling_latency_s":2.904488,"redis_calls":10,"redis_duration_s":0.001518,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000626,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000892,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.003,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017775,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029417,"completed_at":"2026-08-20T06:00:34.354Z","load_balancing_strategy":"primary","db_duration_s":0.010569,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2412gitlab # [ 447.878327] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.356Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"fd737d3d8724f409cf6065c0","created_at":"2026-08-20T06:00:30.994Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-b7460241d2e54a74","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b95c8771c9ab1ce8562631e0d645aa1f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.420Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-fd737d3d8724f409cf6065c0: start","job_status":"start","queue_duration_s":2.936029,"scheduling_latency_s":2.936087}2413gitlab # [ 447.891097] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.383Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"fd737d3d8724f409cf6065c0","created_at":"2026-08-20T06:00:30.994Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-b7460241d2e54a74","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b95c8771c9ab1ce8562631e0d645aa1f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.420Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-fd737d3d8724f409cf6065c0: done: 0.027003 sec","job_status":"done","queue_duration_s":2.936029,"scheduling_latency_s":2.936087,"redis_calls":10,"redis_duration_s":0.001619,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000667,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000952,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017445,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027003,"completed_at":"2026-08-20T06:00:34.383Z","load_balancing_strategy":"primary","db_duration_s":0.006015,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2414gitlab # [ 447.930912] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.385Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7f74806696fa194ad55212c1","created_at":"2026-08-20T06:00:30.994Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-b7460241d2e54a74","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b95c8771c9ab1ce8562631e0d645aa1f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.420Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7f74806696fa194ad55212c1: start","job_status":"start","queue_duration_s":2.965014,"scheduling_latency_s":2.965036}2415gitlab # [ 447.943344] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:34 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 982416gitlab # [ 447.945569] gitaly[891]: time="2026-08-20T06:00:34.679Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=4 command.system_time_ms=9 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M0EW3JGQ0X74EZZ1J57YHAYA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:34.659" grpc.time_ms=20.262 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc2417gitlab # [ 447.959301] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.409Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7f74806696fa194ad55212c1","created_at":"2026-08-20T06:00:30.994Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-b7460241d2e54a74","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b95c8771c9ab1ce8562631e0d645aa1f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.420Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7f74806696fa194ad55212c1: done: 0.02384 sec","job_status":"done","queue_duration_s":2.965014,"scheduling_latency_s":2.965036,"redis_calls":10,"redis_duration_s":0.002423,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001355,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001068,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016788,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02384,"completed_at":"2026-08-20T06:00:34.409Z","load_balancing_strategy":"primary","db_duration_s":0.002047,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2418gitlab # [ 447.997686] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.410Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"00bf941ee60a4cfa3977a5d5","created_at":"2026-08-20T06:00:30.994Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-b7460241d2e54a74","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b95c8771c9ab1ce8562631e0d645aa1f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.420Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-00bf941ee60a4cfa3977a5d5: start","job_status":"start","queue_duration_s":2.989962,"scheduling_latency_s":2.989982}2419gitlab # [ 448.009889] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.436Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"00bf941ee60a4cfa3977a5d5","created_at":"2026-08-20T06:00:30.994Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-b7460241d2e54a74","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b95c8771c9ab1ce8562631e0d645aa1f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.420Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-00bf941ee60a4cfa3977a5d5: done: 0.02635 sec","job_status":"done","queue_duration_s":2.989962,"scheduling_latency_s":2.989982,"redis_calls":10,"redis_duration_s":0.001414,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000571,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000843,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.003,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015265,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02635,"completed_at":"2026-08-20T06:00:34.436Z","load_balancing_strategy":"primary","db_duration_s":0.011132,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2420gitlab # [ 448.048078] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.438Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3f0b64fee9e7098851c55ec6","created_at":"2026-08-20T06:00:30.994Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-b7460241d2e54a74","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b95c8771c9ab1ce8562631e0d645aa1f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.420Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3f0b64fee9e7098851c55ec6: start","job_status":"start","queue_duration_s":3.017451,"scheduling_latency_s":3.01747}2421gitlab # [ 448.060138] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.460Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3f0b64fee9e7098851c55ec6","created_at":"2026-08-20T06:00:30.994Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-b7460241d2e54a74","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b95c8771c9ab1ce8562631e0d645aa1f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.420Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3f0b64fee9e7098851c55ec6: done: 0.02235 sec","job_status":"done","queue_duration_s":3.017451,"scheduling_latency_s":3.01747,"redis_calls":10,"redis_duration_s":0.001493,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000666,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000827,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015033,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02235,"completed_at":"2026-08-20T06:00:34.460Z","load_balancing_strategy":"primary","db_duration_s":0.002361,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2422gitlab # [ 448.098610] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.461Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"808763e4e14aa73a8d519f21","created_at":"2026-08-20T06:00:30.994Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-b7460241d2e54a74","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b95c8771c9ab1ce8562631e0d645aa1f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.420Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-808763e4e14aa73a8d519f21: start","job_status":"start","queue_duration_s":3.040993,"scheduling_latency_s":3.041013}2423gitlab # [ 448.110942] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.485Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"808763e4e14aa73a8d519f21","created_at":"2026-08-20T06:00:30.994Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-b7460241d2e54a74","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b95c8771c9ab1ce8562631e0d645aa1f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.420Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-808763e4e14aa73a8d519f21: done: 0.023843 sec","job_status":"done","queue_duration_s":3.040993,"scheduling_latency_s":3.041013,"redis_calls":10,"redis_duration_s":0.0017590000000000001,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000721,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001038,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016596,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023843,"completed_at":"2026-08-20T06:00:34.485Z","load_balancing_strategy":"primary","db_duration_s":0.002584,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2424gitlab # [ 448.150452] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.487Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"bd2c70c0497157ff4df94cc7","created_at":"2026-08-20T06:00:30.994Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-b7460241d2e54a74","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b95c8771c9ab1ce8562631e0d645aa1f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.420Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-bd2c70c0497157ff4df94cc7: start","job_status":"start","queue_duration_s":3.066621,"scheduling_latency_s":3.066642}2425gitlab # [ 448.163316] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.508Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"bd2c70c0497157ff4df94cc7","created_at":"2026-08-20T06:00:30.994Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-b7460241d2e54a74","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b95c8771c9ab1ce8562631e0d645aa1f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.420Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-bd2c70c0497157ff4df94cc7: done: 0.021297 sec","job_status":"done","queue_duration_s":3.066621,"scheduling_latency_s":3.066642,"redis_calls":10,"redis_duration_s":0.001601,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00064,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000961,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013812,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021297,"completed_at":"2026-08-20T06:00:34.508Z","load_balancing_strategy":"primary","db_duration_s":0.002719,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2426gitlab # [ 448.201888] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.509Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"efdcd48081f52b05fa6d4769","created_at":"2026-08-20T06:00:30.994Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-b7460241d2e54a74","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b95c8771c9ab1ce8562631e0d645aa1f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.420Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-efdcd48081f52b05fa6d4769: start","job_status":"start","queue_duration_s":3.089186,"scheduling_latency_s":3.089208}2427gitlab # [ 448.214010] gitlab-workhorse[818]: time="2026-08-20T06:00:34Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672428gitlab # [ 448.215755] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:34 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 2462429gitlab # [ 448.217705] gitaly[891]: time="2026-08-20T06:00:34.930Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3JKXVNSSNBSRH7X4JBY5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:34.917" pid=891 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2430gitlab # [ 448.228148] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.533Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"efdcd48081f52b05fa6d4769","created_at":"2026-08-20T06:00:30.994Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-b7460241d2e54a74","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b95c8771c9ab1ce8562631e0d645aa1f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.420Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-efdcd48081f52b05fa6d4769: done: 0.023495 sec","job_status":"done","queue_duration_s":3.089186,"scheduling_latency_s":3.089208,"redis_calls":10,"redis_duration_s":0.001656,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000696,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00096,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013919,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023495,"completed_at":"2026-08-20T06:00:34.533Z","load_balancing_strategy":"primary","db_duration_s":0.008609,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2431gitlab # [ 448.266605] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.534Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f5c53854dc71ead6fcf33058","created_at":"2026-08-20T06:00:30.994Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-b7460241d2e54a74","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b95c8771c9ab1ce8562631e0d645aa1f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.420Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f5c53854dc71ead6fcf33058: start","job_status":"start","queue_duration_s":3.114103,"scheduling_latency_s":3.114128}2432gitlab # [ 448.278934] gitaly[891]: time="2026-08-20T06:00:34.930Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=0 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3JKXVNSSNBSRH7X4JBY5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:34.917" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc2433gitlab # [ 448.292469] nix-daemon[3796]: accepted connection from pid 4586, user nixbot2434gitlab # [ 448.293412] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.555Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f5c53854dc71ead6fcf33058","created_at":"2026-08-20T06:00:30.994Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-b7460241d2e54a74","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b95c8771c9ab1ce8562631e0d645aa1f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.420Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f5c53854dc71ead6fcf33058: done: 0.020746 sec","job_status":"done","queue_duration_s":3.114103,"scheduling_latency_s":3.114128,"redis_calls":10,"redis_duration_s":0.0017040000000000002,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000689,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001015,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01388,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020746,"completed_at":"2026-08-20T06:00:34.555Z","load_balancing_strategy":"primary","db_duration_s":0.003041,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2435gitlab # [ 448.333101] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.557Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"44a73049293f07de53dcf114","created_at":"2026-08-20T06:00:30.994Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-b7460241d2e54a74","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b95c8771c9ab1ce8562631e0d645aa1f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.420Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-44a73049293f07de53dcf114: start","job_status":"start","queue_duration_s":3.136448,"scheduling_latency_s":3.136471}2436gitlab # [ 448.345843] gitaly[891]: time="2026-08-20T06:00:34.931Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=0 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3JKXVNSSNBSRH7X4JBY5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:34.917" grpc.time_ms=14.222 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc2437gitlab # [ 448.360891] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.580Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"44a73049293f07de53dcf114","created_at":"2026-08-20T06:00:30.994Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-b7460241d2e54a74","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b95c8771c9ab1ce8562631e0d645aa1f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.420Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-44a73049293f07de53dcf114: done: 0.023814 sec","job_status":"done","queue_duration_s":3.136448,"scheduling_latency_s":3.136471,"redis_calls":10,"redis_duration_s":0.002833,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001206,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001627,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.003,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014974,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023814,"completed_at":"2026-08-20T06:00:34.580Z","load_balancing_strategy":"primary","db_duration_s":0.004106,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2438gitlab # [ 448.400066] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.582Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"69f17332d0b7865801f678e6","created_at":"2026-08-20T06:00:30.994Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-b7460241d2e54a74","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b95c8771c9ab1ce8562631e0d645aa1f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.420Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-69f17332d0b7865801f678e6: start","job_status":"start","queue_duration_s":3.161481,"scheduling_latency_s":3.161502}2439gitlab # [ 448.412172] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.602Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"69f17332d0b7865801f678e6","created_at":"2026-08-20T06:00:30.994Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-b7460241d2e54a74","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b95c8771c9ab1ce8562631e0d645aa1f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.420Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-69f17332d0b7865801f678e6: done: 0.020937 sec","job_status":"done","queue_duration_s":3.161481,"scheduling_latency_s":3.161502,"redis_calls":10,"redis_duration_s":0.00166,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000695,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000965,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013765,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020937,"completed_at":"2026-08-20T06:00:34.602Z","load_balancing_strategy":"primary","db_duration_s":0.003059,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2440gitlab # [ 448.451656] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.604Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7f0fa7171e1f41601f58cc6f","created_at":"2026-08-20T06:00:30.994Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-b7460241d2e54a74","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b95c8771c9ab1ce8562631e0d645aa1f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.420Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7f0fa7171e1f41601f58cc6f: start","job_status":"start","queue_duration_s":3.183682,"scheduling_latency_s":3.183705}2441gitlab # [ 448.464465] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.623Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7f0fa7171e1f41601f58cc6f","created_at":"2026-08-20T06:00:30.994Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-b7460241d2e54a74","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b95c8771c9ab1ce8562631e0d645aa1f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.420Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7f0fa7171e1f41601f58cc6f: done: 0.018837 sec","job_status":"done","queue_duration_s":3.183682,"scheduling_latency_s":3.183705,"redis_calls":10,"redis_duration_s":0.0016640000000000001,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000706,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000958,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013363,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018837,"completed_at":"2026-08-20T06:00:34.622Z","load_balancing_strategy":"primary","db_duration_s":0.001478,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2442gitlab # [ 448.504111] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.624Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"16e7ae6a3da232eefc9640f0","created_at":"2026-08-20T06:00:30.994Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-b7460241d2e54a74","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b95c8771c9ab1ce8562631e0d645aa1f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.420Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-16e7ae6a3da232eefc9640f0: start","job_status":"start","queue_duration_s":3.2037,"scheduling_latency_s":3.203719}2443gitlab # [ 448.515922] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.643Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"16e7ae6a3da232eefc9640f0","created_at":"2026-08-20T06:00:30.994Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-b7460241d2e54a74","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b95c8771c9ab1ce8562631e0d645aa1f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.420Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-16e7ae6a3da232eefc9640f0: done: 0.018879 sec","job_status":"done","queue_duration_s":3.2037,"scheduling_latency_s":3.203719,"redis_calls":10,"redis_duration_s":0.001727,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000762,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000965,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013492,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018879,"completed_at":"2026-08-20T06:00:34.643Z","load_balancing_strategy":"primary","db_duration_s":0.001343,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2444gitlab # [ 448.555846] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.644Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c640e0e1d33628ad4193744d","created_at":"2026-08-20T06:00:30.994Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-b7460241d2e54a74","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b95c8771c9ab1ce8562631e0d645aa1f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.420Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c640e0e1d33628ad4193744d: start","job_status":"start","queue_duration_s":3.223778,"scheduling_latency_s":3.223797}2445gitlab # [ 448.568284] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.665Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c640e0e1d33628ad4193744d","created_at":"2026-08-20T06:00:30.994Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-b7460241d2e54a74","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b95c8771c9ab1ce8562631e0d645aa1f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.420Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c640e0e1d33628ad4193744d: done: 0.020756 sec","job_status":"done","queue_duration_s":3.223778,"scheduling_latency_s":3.223797,"redis_calls":10,"redis_duration_s":0.004211,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003336,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000875,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012907,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020756,"completed_at":"2026-08-20T06:00:34.665Z","load_balancing_strategy":"primary","db_duration_s":0.001323,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2446gitlab # [ 448.606866] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.666Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f2a934cc742ddd1e0d7893d5","created_at":"2026-08-20T06:00:30.994Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-b7460241d2e54a74","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b95c8771c9ab1ce8562631e0d645aa1f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.420Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f2a934cc742ddd1e0d7893d5: start","job_status":"start","queue_duration_s":3.245749,"scheduling_latency_s":3.245785}2447gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1cdfdcaac5d2032ba64a258aa245ab4017e01fcb/statuses2448gitlab # [ 448.619236] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.685Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f2a934cc742ddd1e0d7893d5","created_at":"2026-08-20T06:00:30.994Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-b7460241d2e54a74","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b95c8771c9ab1ce8562631e0d645aa1f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.420Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f2a934cc742ddd1e0d7893d5: done: 0.019594 sec","job_status":"done","queue_duration_s":3.245749,"scheduling_latency_s":3.245785,"redis_calls":10,"redis_duration_s":0.002484,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000622,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001862,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013375,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019594,"completed_at":"2026-08-20T06:00:34.685Z","load_balancing_strategy":"primary","db_duration_s":0.001518,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2449gitlab # [ 448.654821] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.687Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"bab348c5bdbe112d4e23d3b4","created_at":"2026-08-20T06:00:30.994Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-b7460241d2e54a74","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b95c8771c9ab1ce8562631e0d645aa1f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.420Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-bab348c5bdbe112d4e23d3b4: start","job_status":"start","queue_duration_s":3.266926,"scheduling_latency_s":3.266945}2450gitlab # [ 448.667046] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.706Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"bab348c5bdbe112d4e23d3b4","created_at":"2026-08-20T06:00:30.994Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-b7460241d2e54a74","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b95c8771c9ab1ce8562631e0d645aa1f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.420Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-bab348c5bdbe112d4e23d3b4: done: 0.019382 sec","job_status":"done","queue_duration_s":3.266926,"scheduling_latency_s":3.266945,"redis_calls":10,"redis_duration_s":0.002214,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001112,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001102,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012506,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019382,"completed_at":"2026-08-20T06:00:34.706Z","load_balancing_strategy":"primary","db_duration_s":0.002578,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2451gitlab # [ 448.706148] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.708Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5c399546656c704e41534b43","created_at":"2026-08-20T06:00:30.994Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-b7460241d2e54a74","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b95c8771c9ab1ce8562631e0d645aa1f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.420Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5c399546656c704e41534b43: start","job_status":"start","queue_duration_s":3.287616,"scheduling_latency_s":3.287633}2452gitlab # [ 448.718599] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.727Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5c399546656c704e41534b43","created_at":"2026-08-20T06:00:30.994Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-b7460241d2e54a74","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b95c8771c9ab1ce8562631e0d645aa1f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.420Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5c399546656c704e41534b43: done: 0.019266 sec","job_status":"done","queue_duration_s":3.287616,"scheduling_latency_s":3.287633,"redis_calls":10,"redis_duration_s":0.002313,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000939,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001374,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012415,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019266,"completed_at":"2026-08-20T06:00:34.727Z","load_balancing_strategy":"primary","db_duration_s":0.002433,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2453gitlab # [ 448.758408] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.728Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3091f361810a252ae2cf7502","created_at":"2026-08-20T06:00:30.994Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-b7460241d2e54a74","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b95c8771c9ab1ce8562631e0d645aa1f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.420Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3091f361810a252ae2cf7502: start","job_status":"start","queue_duration_s":3.308343,"scheduling_latency_s":3.308361}2454gitlab # [ 448.770700] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.748Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3091f361810a252ae2cf7502","created_at":"2026-08-20T06:00:30.994Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-b7460241d2e54a74","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b95c8771c9ab1ce8562631e0d645aa1f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.420Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3091f361810a252ae2cf7502: done: 0.02005 sec","job_status":"done","queue_duration_s":3.308343,"scheduling_latency_s":3.308361,"redis_calls":10,"redis_duration_s":0.00248,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001061,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001419,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012836,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02005,"completed_at":"2026-08-20T06:00:34.748Z","load_balancing_strategy":"primary","db_duration_s":0.00263,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2455gitlab # [ 448.809295] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.750Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"8c18d3657072c1cada091fb4","created_at":"2026-08-20T06:00:30.994Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-b7460241d2e54a74","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b95c8771c9ab1ce8562631e0d645aa1f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.420Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-8c18d3657072c1cada091fb4: start","job_status":"start","queue_duration_s":3.329891,"scheduling_latency_s":3.329908}2456gitlab # [ 448.821482] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.769Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"8c18d3657072c1cada091fb4","created_at":"2026-08-20T06:00:30.994Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-b7460241d2e54a74","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b95c8771c9ab1ce8562631e0d645aa1f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.420Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-8c18d3657072c1cada091fb4: done: 0.01929 sec","job_status":"done","queue_duration_s":3.329891,"scheduling_latency_s":3.329908,"redis_calls":10,"redis_duration_s":0.002429,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001007,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001422,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012271,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01929,"completed_at":"2026-08-20T06:00:34.769Z","load_balancing_strategy":"primary","db_duration_s":0.002583,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2457gitlab # [ 448.859772] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.771Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"bf32649f8fe9068c8010f45d","created_at":"2026-08-20T06:00:30.994Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-b7460241d2e54a74","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b95c8771c9ab1ce8562631e0d645aa1f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.420Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-bf32649f8fe9068c8010f45d: start","job_status":"start","queue_duration_s":3.350581,"scheduling_latency_s":3.350597}2458gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1cdfdcaac5d2032ba64a258aa245ab4017e01fcb/statuses, in 0.26 seconds)2459(finished: subtest: eval and build post commit statuses, in 6.44 seconds)2460(finished: run the VM test script, in 521.39 seconds)2461gitlab # [ 448.872395] gitaly[891]: time="2026-08-20T06:00:35.597Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3KDHSAAV0RM1RXT6FTJ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:01:05.595" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:35.596" grpc.time_ms=0.854 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2462gitlab # [ 448.885042] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:35 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/1cdfdcaac5d2032ba64a258aa245ab4017e01fcb/statuses HTTP/1.1" 200 1328 "" "curl/8.21.0" 1502463test script finished in 521.44s2464cleanup2465kill QemuMachine (pid 46)2466gitlab # [ 448.887659] sidekiq-cluster[3530]: {"severity":"INFO","time":"2026-08-20T06:00:34.790Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"bf32649f8fe9068c8010f45d","created_at":"2026-08-20T06:00:30.994Z","trace_propagation_headers":{"sentry-trace":"a9138088592842deb57a1193db2d9b5b-b7460241d2e54a74","baggage":"sentry-trace_id=a9138088592842deb57a1193db2d9b5b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"b95c8771c9ab1ce8562631e0d645aa1f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.420Z","job_size_bytes":2,"pid":3530,"sidekiq_tid":"m8pu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-bf32649f8fe9068c8010f45d: done: 0.019801 sec","job_status":"done","queue_duration_s":3.350581,"scheduling_latency_s":3.350597,"redis_calls":10,"redis_duration_s":0.002563,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001062,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001501,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012443,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019801,"completed_at":"2026-08-20T06:00:34.790Z","load_balancing_strategy":"primary","db_duration_s":0.002785,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2467gitlab # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/41m77i1296n33p6liin8ynr6wh3h6b7m-python3-3.14.6/bin/python3.14)2468(finished: cleanup, in 1.42 seconds)2469additionally exposed symbols:2470 gitlab,2471 vlan1,2472 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2473[]2474[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-08-20T05:58:50.882Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2475[]2476[]2477[]2478[]2479[]2480[]2481[]2482[]2483[]2484[]2485[]2486[]2487[]2488[]2489[]2490[]2491[]2492[]2493[]2494[]2495[]2496[]2497[]2498[]2499[]2500[]2501[]2502[]2503[]2504[]2505[]2506[]2507[]2508[]2509[]2510[]2511[]2512[]2513[]2514[]2515[]2516[]2517[]2518[]2519[]2520[]2521[]2522[]2523[]2524[]2525[]2526[]2527[]2528[]2529[]2530[]2531[]2532[]2533[]2534[]2535[]2536[]2537[]2538[]2539[]2540[]2541[]2542[]2543[]2544[]2545[]2546[]2547[]2548[]2549[]2550[]2551[]2552[]2553[]2554[]2555[]2556[]2557[]2558[]2559[]2560[]2561[]2562[]2563[]2564[]2565[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-08-20T06:00:28.229121Z', 'started_at': '2026-08-20T06:00:28.638545Z', 'finished_at': None}]2566[{'id': 5, 'sha': '1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-20T06:00:28.592Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2567[{'id': 5, 'sha': '1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-20T06:00:28.592Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2568[{'id': 5, 'sha': '1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-20T06:00:28.592Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2569[{'id': 5, 'sha': '1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-20T06:00:28.592Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2570[{'id': 5, 'sha': '1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-08-20T06:00:28.592Z', 'started_at': None, 'finished_at': '2026-08-20T06:00:33.911Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'building attributes', 'created_at': '2026-08-20T06:00:34.145Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2571[{'id': 5, 'sha': '1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-08-20T06:00:28.592Z', 'started_at': None, 'finished_at': '2026-08-20T06:00:33.911Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '1cdfdcaac5d2032ba64a258aa245ab4017e01fcb', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '0 attributes built', 'created_at': '2026-08-20T06:00:34.145Z', 'started_at': None, 'finished_at': '2026-08-20T06:00:34.392Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]